Before we begin, you might ask, why am I writing on something this trivial? I sold off my old MacBook Pro because I'm super excited about the new M1 Pro MacBook Pros. I have pre-ordered one of those ...
Read MoreTag: bigdata
Apache Airflow is another awesome tool that I discovered just recently. Just a couple of months after discovering it, I can't imagine not using it now. It's reliable, configurable, and dynamic. Becau...
Read More
In this post, we'll see how we can query tables that reside in Hive using a Spring Boot application. As always, I'm going to use a Spring Boot web app with a few GET APIs to show how we can query dat...
Read More
JanusGraph is a graph processing tool that can process graphs stored on clusters with multiple nodes. JanusGraph is designed for massive clusters and for real-time traversals and analytics queries. ...
Read More
When you're starting your machine learning journey, you'll come across null hypothesis and the p-value. At a certain point in your journey, it becomes quite important to know what these mean to make ...
Read More
We have seen methods such as fit(), transform(), and fit_transform() in a lot of SciKit's libraries. And almost all tutorials, including the ones I've written, only tell you to just use one of these ...
Read More
In the previous post, we tried to understand the basics of Apache's Kafka Streams. In this post, we'll build on that knowledge and see how Kafka Streams can be used both as streams and tables. St...
Read More
If you work with streams of big data which have to be collected, transformed, and analysed, you for sure would have heard of Amazon Kinesis Firehose. It is an AWS service used to load streams of data...
Read More
In the last post, we saw how to query data from S3 using Amazon Athena in the AWS Console. But querying from the Console itself if very limited. We can't really do much with the data, and anytime we ...
Read More Amazon Athena is defined as "an interactive query service that makes it easy to analyze data directly in Amazon Simple Storage Service (Amazon S3) using standard SQL." So, it's another SQL query engi...
Read More