Tag: <span>DistCp</span>

Tag: DistCp

“Client cannot authenticate via:[TOKEN, KERBEROS]” error in Oozie DistCp Action

When copying data across clusters using DistCp action through Oozie in a secured environment, due to a current Oozie bug, the job will fail with below error message: This is a known issue and reported in the upstream JIRA of OOZIE-2900 This JIRA has been fixed in CDH6 and above. …

Loading

How to use “filters” to exclude files when in DistCp

This article explains how to use the new feature supported in Apache Hadoop 2.6.0 to filter out the files that don’t need to be DistCp-ed. Hadoop 2.8.0 added support to filter out certain files that match certain regular expressions, so that they won’t be copied to destination when DistCp command …

Loading

My new Snowflake Blog is now live. I will not be updating this blog anymore but will continue with new contents in the Snowflake world!