Apache Hive is a complex system when you look at it, but once you go looking for more info, it's more interesting than complex. There are multiple query engines available for Hive, and then there's L...
Read MoreCategory: Data Science
In the previous series of posts, I wrote about how to install the complete Hadoop stack on Windows 11 using WSL 2. And now that the new MacBook Pro laptops are available with the brand new M1 Pro and...
Read More
In the previous post, we saw how to install a Linux distro on Windows 11 using WSL2 and then how to install Zsh and on-my-zsh to make the terminal more customizable. In this post, we'll see how we ca...
Read More
Apache Airflow is another awesome tool that I discovered just recently. Just a couple of months after discovering it, I can't imagine not using it now. It's reliable, configurable, and dynamic. Becau...
Read More
I was recently tasked with creating some random customer data, with names, phone numbers, addresses, and the usual other stuff. At first, I thought I'll just generate random strings and numbers (some...
Read More
In this post, we'll see how we can query tables that reside in Hive using a Spring Boot application. As always, I'm going to use a Spring Boot web app with a few GET APIs to show how we can query dat...
Read More
If you are new to JanusGraph and the Gremlin query language, like I am, you would be confused about the out(), outE(), in(), and inE() methods. If you look at examples of these functions, you'll not ...
Read More JanusGraph is a graph processing tool that can process graphs stored on clusters with multiple nodes. JanusGraph is designed for massive clusters and for real-time traversals and analytics queries. ...
Read More
I have talked about Kinesis before, and I'm sure you've been using Kinesis for longer than me. But according to what I've seen, not all teams or companies use all parts of Kinesis. And, there are fou...
Read More
Parquet is an open source file format by Apache for the Hadoop infrastructure. Well, it started as a file format for Hadoop, but it has since become very popular and even cloud service providers such...
Read More