Tag Archives: kafka

Integrating Kafka With Spark Structure Streaming


Kafka is a messaging broker system which facilitates the passing of messages between producer and consumer whereas Spark Structure streaming consumes static and streaming data from various sources like kafka, flume, twitter or any other socket which can be processed … Continue reading

Posted in Apache Kafka, apache spark, Scala, Streaming | Tagged , , | 1 Comment

Streaming in Spark, Flink and Kafka


There is a lot of buzz going on between when to use use spark, when to use flink, and when to use Kafka. Both spark streaming and flink provides exactly once guarantee that every record will be processed exactly once … Continue reading

Posted in Apache Flink, Apache Kafka, apache spark, Streaming | Tagged , , , | Leave a comment

Introducing Kafka Streams: Processing made easy


If you are working on huge amount of data, you might have heard about Kafka. At a very high level, Kafka is a fault tolerant, distributed publish-subscribe messaging system that is designed for fast processing of data and the ability … Continue reading

Posted in Java, big data, Streaming | Tagged , , , | 1 Comment

Message Broker in Lagom using Kafka


What is Lagom? Lagom framework helps in simplifying the development of microservices by providing an integrated development environment. This benefits one by allowing them to focus on solving business problems instead of wiring services together. Lagom exposes two APIs, Java and … Continue reading

Posted in Scala | Tagged , , , , , , , | 1 Comment

Integrating Play app with Lagom application


What is Lagom? Simply put, it is a microservices tool. Lagom is a microservices framework that guides developers in moving from monolithic to a scalable, resilient microservice based systems. It is a platform delivering you not only the microservice framework … Continue reading

Posted in Cassandra, integration, knoldus, Scala | Tagged , , , , , , , | 3 Comments

Short Interview With SMACK Tech Stack !!!


Hello guy’s, today’s we conduct short interview with SMACK about its architecture and there uses. Let’s start with of some introduction. Interviewer: How would you describe your self ? SMACK: I am SMACK (Spark, Mesos, Akka, Cassandra and Kafka) and … Continue reading

Posted in Akka, Apache Kafka, apache spark, big data, Cassandra, Scala, Spark | Tagged , , , , , , , , , , , , | Leave a comment

Kafka-Avro-Scala-Example


This post will show you how to write and read messages in Avro format to/from Kafka. Instead of using with plain-text messages, though, we will serialize our messages with Avro. That will allow us to send much more complex data … Continue reading

Posted in Scala | Tagged , , | Leave a comment

Introduction to Kafka Connect


Knoldus organized a half an hour session on 29 July 2016 at 4:00 PM. It covers a brief introduction to Apache Kafka Connect, giving insights about the benefits of kafka connect, its use cases. It also covers the motivation behind … Continue reading

Posted in Apache Kafka, Scala | Tagged , , , | Leave a comment