kafka producer

How to solve Producer and Consumer problems

Reading Time: 3 minutes In this blog, we will learn about how to solve producer and consumer problems using Kafka and Docker. It’s going to be interesting. So stay tuned Kafka is a high-performance, real-time, and also publish-subscribe messaging system. It is an open-source tool as well as a part of Apache Projects. Some Characteristics of Kafka are:- Firstly it is a distributed and partitioned messaging system. Secondly, Kafka Continue Reading

Non-HTTP Contract Test (Message Pact)

Reading Time: 4 minutes This blog shows how to create a contract between producer and consumer using the Message Pact framework. What is Contract Testing? Contract testing is writing tests to make sure the services can communicate well with each other. There are two perspectives in Contract testing: One is the consumer entity using the service and other one is the provider entity that provides the service. As an Continue Reading

Kafka Producer Internals

Reading Time: 3 minutes Hello everyone, I know there are lot of blogs present on the kafka you can go through. So that rather than explaing the basic concepts of kafka and architecture, Here we will look into the kafka producer internals.Will see that what happens internally when producer send the message into topic. Also will see what happens when consumer consumes messages. Imagine….. Let’s suppose producer wants to Continue Reading

Take a deep dive into Kafka – Producer API

Reading Time: 4 minutes I am going to start a series of blogs on Kafka API. This blog is a part of the series. In the series of blogs In this blog, we are going to learn about Producer-API. If you are new to Kafka then I will recommend you to first get some basic idea about Kafka Quickstart from kafka-quickstart . There are many reasons an application might Continue Reading

Hands-on: Apache Kafka with Scala

Reading Time: 4 minutes Apache Kafka is an open sourced distributed streaming platform used for building real-time data pipelines and streaming applications. It is horizontally scalable, fault-tolerant, wicked fast, and runs in production in thousands of companies. Before the introduction of Apache Kafka, data pipleines used to be very complex and time-consuming. A separate streaming pipeline was needed for every consumer. You can guess the complexity of it with Continue Reading