This article explains how to query a multi delimited Hive table in CDH5.3.x. Use case as follow: Having the following table definitions: Query all columns is OK: However, query a single column will get the following error in HS2: This happens in CDh5.3.3, which ships Hive 0.13, and I am …
This article explains how to solve the issue that UNION ALL returns zero record with aggregate functions in SELECT statement The following is the test case: UNION ALL without COUNT function will work as expected: Run the same query without setting hive.mapred.supports.subdirectories and hive.optimize.union.remove to true will give correct result: …
This article explains how to use the new feature supported in Apache Hadoop 2.6.0 to filter out the files that don’t need to be DistCp-ed. Hadoop 2.8.0 added support to filter out certain files that match certain regular expressions, so that they won’t be copied to destination when DistCp command …
My new Snowflake Blog is now live. I will not be updating this blog anymore but will continue with new contents in the Snowflake world!