Month: July 2015

This article explains how to configure the following settings in Hive: hive.server2.session.check.interval hive.server2.idle.operation.timeout hive.server2.idle.session.timeout 1). hive.server2.idle.session.timeout Session will be closed when not accessed for this duration of time, in milliseconds; disable by setting to zero or a negative value. For example, the value of “86400000” indicate that the session will …

We have the following data: How to load the data into a Hive table with delimiter “~|`”? Well, it is pretty straightforward, just use the “MultiDelimitSerDe” which is available since CDH5.1.4, example as folllows: After loading the data, the table will look something like this: This is the preferred way …

We know that Hive will create a partition with value “__HIVE_DEFAULT_PARTITION__” when running in dynamic partition mode and the value for the partition key is “null” value. However, depending on on the partition column type, you might not be able to drop those partitions due to restrictions in the Hive …

This post explain what you need to do when you see container “is running beyond physical memory limits” error in the hive application log. Symptoms: Hive query failed with the following error in the application log: Cause: There is not enough memory allocated to each container that will trigger the …