Hive unable to read Snappy files generated by Hive and Flume together

This article explains the workarounds to avoid the Hive query failure when processing snappy files generated by Hive and Flume under the same directory. The following are the steps to re-produce the issue: A Hive table (from_hive) with its data injected from Flume Create another table with same column structure (from_flume) Insert data …

Sqoop job failed with “Malformed option in options file” error

Recently I discovered a bug in Sqoop that it wrongly detects a malformed query in options file, but in fact the query is totally correct. Example as below sqoop command: and in the /path/to/options-file.txt, it contains the following content: Sqoop will fail with the following error: This is caused by …

How to setup multiple KDCs through Cloudera Manager

Currently Cloudera Manager does not support setting up multiple KDCs for the krb5.conf file natively, this article explains the workarounds we can have using the existing feature provided by Cloudera Manager. This article also assumes that you have krb5.conf file managed by Cloudera Manager. If you are using Cloudera Manager …

Impala query failed with error “IllegalStateException”

This article examples ONE of the possible causes for the issue that Impala query failed with IllegalStateException error. Recently I was dealing with an Impala issue that when runnnig a simple SELECT query against a table failed with IllegalStateException error: Checking the impala daemon log shows the following stacktrace: Based on …