Real-Time Data Processing: Understanding the What, Why, Where, Who, and HowData ScienceTech by Sunny Srinidhi - October 22, 20240 In today’s data-driven world, businesses and organizations are continuously generating massive amounts of data. While processing data in batch mode remains useful, the need for instant decision-making has led to an increasing focus on real-time data processing. This article delves into what real-time data processing is, why it's essential, its various applications, the tools used to achieve it, trends shaping its evolution, and real-world use cases. What is Real-Time Data Processing? Real-time data processing refers to the capability to continuously ingest, process, and output data as soon as it is generated, with minimal latency. Unlike batch processing, which collects and processes data in large groups at set intervals (e.g., daily or hourly), real-time processing works with data immediately as it becomes available,
Understanding Data Governance: A Comprehensive GuideData ScienceTech by Sunny Srinidhi - October 18, 2024October 18, 20240 Data governance is a set of practices, policies, and standards that ensure data is managed as an asset in a consistent and reliable manner across an organization. It involves defining who owns the data, who has the right to make decisions about it, and how it can be used. This comprehensive guide aims to shed light on what data governance entails, its importance, how it can be achieved, best practices, and who should be involved in the process. What is Data Governance? Data governance refers to the collection of policies, roles, responsibilities, and procedures that oversee the management of data assets within an organization. It ensures that data is accurate, consistent, accessible, and protected from misuse. The main goal of data governance
The Trend of Cloud Repatriation: Moving Back to On-Premises InfrastructureData ScienceTech by Sunny Srinidhi - October 16, 2024October 16, 20240 In recent years, a shift in IT infrastructure strategies has seen many companies moving workloads away from public cloud services and back to on-premises setups or private cloud environments. This movement, known as "cloud repatriation," is driven by various factors that range from cost management to performance, security, and compliance concerns. While public cloud adoption surged over the past decade, the limitations of this model have led organizations to reconsider their approach, resulting in a hybrid IT strategy combining both on-premises and cloud resources. Why Companies Are Moving Back to On-Premises 1. Cost Considerations One of the most prominent factors driving cloud repatriation is the realization of the high costs associated with public cloud services. While the cloud offers scalability and flexibility, many companies
Use Amazon CloudSearch to quickly search through dataTech by Sunny Srinidhi - March 29, 2023January 17, 20240 Amazon CloudSearch provides a number of powerful search capabilities, including full-text search, faceted search, and customizable relevance ranking. In this post, we’ll see what CloudSearch is
The Dunning-Kruger Effect In TechTech by Sunny Srinidhi - November 28, 2021December 18, 20210 The Dunning-Kruger effect is very real in the tech industry. In this post, I talk about my experience with it in the industry.
Installing Zsh and Oh-my-zsh on Windows 11 with WSL2Tech by Sunny Srinidhi - October 27, 2021October 27, 20211 In this post, which is a part of a series of to setup Windows 11 and WSL2 for big data work, I install Zsh and Oh-my-zsh and setup up aliases
Querying Hive Tables From a Spring Boot AppData ScienceTech by Sunny Srinidhi - June 30, 2021June 30, 20211 In this post, we’ll see how to connect to a Hive database and run queries on that database from a Spring Boot application.
I made a website which tells if you’re wearing a mask or not – without machine learningTech by Sunny Srinidhi - January 11, 2021January 11, 20211 In this post, I talk about how I built a website which can detect maks, gloves, and more – all without writing any machine learning code.
Free apps vs. Paid appsTech by Sunny Srinidhi - December 19, 20200 Even though free apps are, well, free, they actually are not. Learn how you’re paying for all the free apps you download.
Binary Search Tree Implementation in JavaTech by Sunny Srinidhi - October 1, 2020October 1, 20200 In this post, we’ll see how to implement binary search tree data structure in Java. Also, we’ll see how to construct and traverse a BST.