Choreography-based Saga for Microservices and Serverless ApplicationsTech by Sunny Srinidhi - April 1, 20200 How do you take care of transactions in a microservices or serverless architecture? We’ll talk about choreography-based saga to solve this.
Understanding Data Mesh: A Paradigm Shift in Data ManagementData ScienceTech by Sunny Srinidhi - January 2, 2025January 2, 20250 Data Mesh is a decentralized approach to data management that treats data as a product and assigns ownership to domain-specific teams. By breaking away from centralized architectures like data warehouses and lakes, it ensures scalability, agility, and improved data quality. Emphasizing principles like domain-oriented ownership, self-serve infrastructure, and federated governance, Data Mesh enables faster insights, fosters collaboration, and breaks down silos. With applications across industries like e-commerce, healthcare, and finance, it transforms how organizations leverage data while addressing challenges like governance complexity and cultural shifts.
Redundancy in a distributed systemTech by Sunny Srinidhi - April 13, 20200 We don’t think of introducting redundancy in our systems early enough. This is bad. Let’s see why with an example, and how to fix it.
Getting started with Apache Kafka StreamsData ScienceTech by Sunny Srinidhi - September 30, 2019March 12, 20201 In the age of big data and data science, stream processing is very significant. So it's not at all surprising that every major organisation has at least one stream processing service. Apache has a few too, but today we're going to look at Apache's Kafka Streams. Kafka is a very popular pub-sub service. And if you've worked with Kafka before, Kafka Streams is going to be very easy to understand. And if you haven't got any idea of Kafka, you don't have to worry, because most of the underlying technology has been abstracted in Kafka Streams so that you don't have to deal with consumers, producers, partitions, offsets, and the such. In this post, we'll look that a few concepts of
How you can improve your backend services’ performance using Apache KafkaTech by Sunny Srinidhi - November 27, 2018February 25, 20201 In most real world applications, we have a RESTful API service facing various client applications and a collection of backend services which process the data coming from those clients. Depending on the application, the architecture might have various services spread across multiple clusters of servers, and some form of queue or messaging service gluing them together. Today, we're going to talk about one such messaging service - Apache Kafka - and how it can improve the performance of your services. We're going to assume that we have at least two microservices, one for the APIs that are exposed to the world, and one which processes the requests coming in from the API microservice, but in an async fashion. Because this is