Year: <span>2015</span>

Year: 2015

Impala query with GRUOP BY clause failed without disk spilling

This article explains one of the possible reasons that caused Impala query to fail with Out of Memory Exception. The following is the profile from failed query: This query was big, and used more than 60GB of memory, in theory with GROUP BY, Impala should trigger disk spilling when it …

Loading

Query to Hive RCFile table with error “LazySimpleSerDe: expects either BytesWritable or Text object”

Steps to re-produce the issue: 1) Create a Hive table using following command: 2) Load data into the table: 3) Get the output of table definition: and we get the following output: 4) Use the output from step 3. to create a new table: 5) Manually copy data from table …

Loading

My new Snowflake Blog is now live. I will not be updating this blog anymore but will continue with new contents in the Snowflake world!