Author Archives: jatindemla

Integrating Kafka With Spark Structure Streaming

Posted on June 18, 2017

Kafka is a messaging broker system which facilitates the passing of messages between producer and consumer whereas Spark Structure streaming consumes static and streaming data from various sources like kafka, flume, twitter or any other socket which can be processed … Continue reading →

Posted in Apache Kafka, apache spark, Scala, Streaming | Tagged , , | 1 Comment

Avro Communication over TCP Sockets

Posted on May 15, 2017

Storing/Transferring object is a requirement of most applications. What if there is a need for communication between machine having incompatible architecture. Java Serialization won’t work for that. Now, if you are thinking about Serialization Framework then you are right. So, … Continue reading →

Posted in Scala | Tagged , | 1 Comment