A couple of years ago, I wrote a blog about how to securely managing passwords in Sqoop, so that the RDBMS’ password won’t be exposed to end users when running Sqoop jobs. The details can be found here. Recently, we have one customer tested such feature with Hive accessing S3 …
The file path in S3 will always has the following format: http://{bucket-name}.s3.amazonaws.com/<path_to_file> Now, ff you are given a link to a file inside of s3 in the following format: s3://my-bucket/test-folder/dir1/test-file.txt You should be able to convert it to the following url: http://my-bucket.s3.amazonaws.com/test-folder/dir1/test-file.txt So, you can now easily convert s3 protocol to http …
My new Snowflake Blog is now live. I will not be updating this blog anymore but will continue with new contents in the Snowflake world!