This articles explains one of the possibilities that could have caused catalogd to crash constantly. The following are the symptoms when this issue happens: Impala Catalog server keeps crashing after restarting of Catalog server, query back to normal when impala is under heavy load, catalog server will crash again One …
If you encountered the following error while importing Oracle table into HDFS: Chances are that you are hitting a Sqoop bug: SQOOP-117 At the time of writing, it is not fixed yet, but we can have a very simple workaround for this issue. Simply use –map-column-java option supported by Sqoop, …
This article explains how to fix the following error when running a hive query: This error might not be obvious, however, this is caused by the following config not setup properly in YARN: mapreduce.map.memory.mb = 1638 yarn.scheduler.maximum-allocation-mb = 1200 yarn.nodemanager.resource.memory-mb = 1300 The solution here is to change the above …
When a simple count query in Hive like below: with 2GB of data takes almost 30 minutes to finish in a reasonable sized cluster like 10 nodes, how do you determine the cause of the slowness? There are many possible causes of this issue, however, I think the following three …
My new Snowflake Blog is now live. I will not be updating this blog anymore but will continue with new contents in the Snowflake world!