If you have both Hive and Spark running on the same cluster, chances are that Hive CLI will probably produce the following WARNING message upon exit of each session: Sample full output looks like below: Even though Hive CLI has been deprecated in CDH, there are still lots of enterprise …
I have seen lots of Hadoop users are not using Big Data technology correctly. Hadoop is designed for Big Data, so it works well with large file sizes and this is why we have block size for HDFS as 256MB or 512MB depending on use cases. However, lots of users, …
Yesterday i was working on a very weird issue in Hive that the SHOW CREATE TABLE for a VIEW returned partial output. This happened in Hue, Beeline as well as Hive CLI. Please see below test case: 1. From Hue interface: 2. From Beeline: 3. From Hive CLI: After some …
Recently I was dealing with an issue that after user upgraded CDH to 5.12.x, HiveServer2 was unable to start up. Examining the HiveServer2 log we noticed that for some reason HiveServer2 was try to access HiveMetaStore database and returned table does not exist error. See below full stacktrace: If you …
If you are using Hive JDBC/ODBC driver to create Parquet data via Hive, and you face below error when reading from Impala: It is most likely that you hit a known issue HIVE-15519. Due to this bug, the DECIMAL scale value returned from the driver was incorrect (returns null), hence …
My new Snowflake Blog is now live. I will not be updating this blog anymore but will continue with new contents in the Snowflake world!