Getting Started With Apache AirflowData Science by Sunny Srinidhi - October 11, 2021October 11, 20210 I recently started working with Apache Airflow. And as is tradition, I’m telling you everything about it here.
Redundancy in a distributed systemTech by Sunny Srinidhi - April 13, 20200 We don’t think of introducting redundancy in our systems early enough. This is bad. Let’s see why with an example, and how to fix it.
Proof of Concepts (POCs) I write a lot of POC projects, especially when I'm learning something new or I need to quickly test if a data pipeline works, or maybe I'm just testing a new integration. I make all these POCs public as Github repositories. I wanted to consolidate the list of POCs in an easy to search fashion. And that's why I have this page here. Below is a list of all the POCs that I've written so far. If a particular POC has an accompanying blog post which explains the code in the POC, I have linked that blog post as well in the list below. Let me know if any of these POCs have helped you in any way.
How to Query Athena from a Spring Boot application?Data ScienceTech by Sunny Srinidhi - September 25, 2019March 3, 20203 In the last post, we saw how to query data from S3 using Amazon Athena in the AWS Console. But querying from the Console itself if very limited. We can't really do much with the data, and anytime we want to analyse this data, we can't really sit in front of the console the whole day and run queries manually. We need to automate the process. And what better way to do that than writing a piece of code? So in this post, we'll see how we can use the AWS Java SDK in a Spring Boot application and query the same sample data set from the previous post. We'll then log it to the console to make sure we're
About Me Connect with me on: Twitter | LinkedIn | Medium Products Finance Journal Finance Journal is your personal command center for your money. It replaces messy spreadsheets and mental math with a beautiful, easy-to-use app that gives you total clarity on your financial life. Here is what it does for you: See Where Your Money Goes: Don't just track "how much"—track "where" and "why." Tag expenses with specific locations (powered by Google Maps), categories, and even specific trips to see exactly what lifestyle choices drive your spending. Visual Insights: Instantly understand your habits with a dashboard that turns your data into clear, easy-to-read charts and trends. Travel Made Easy: Planning a getaway? Dedicated trip tracking lets you keep your vacation budget separate from your daily expenses, so you can relax without the