Knoldus Blogs

Integrating Kafka With Spark Structure Streaming

June 18, 2017August 20, 2018Apache Kafka, Apache Spark, Streaming, Studio-Scalakafka, Spark, Streaming

Reading Time: 2 minutes Kafka is a messaging broker system which facilitates the passing of messages between producer and consumer whereas Spark Structure streaming consumes static and streaming data from various sources like kafka, flume, twitter or any other socket which can be processed and analysed using high level algorithm for machine learning and finally pushed the result out to external storage system. The main advantage of structured streaming Continue Reading

Introducing Kafka Streams: Processing made easy

June 12, 2017June 12, 2017Big Data and Fast Data, Java, StreamingExamples, kafka, opensource, Streaming

Reading Time: 2 minutes If you are working on huge amount of data, you might have heard about Kafka. At a very high level, Kafka is a fault tolerant, distributed publish-subscribe messaging system that is designed for fast processing of data and the ability to handle hundreds of thousands of messages. What is Stream Processing Stream processing is the real-time processing of data continuously, concurrently, and in a record-by-record Continue Reading

Short Interview With SMACK Tech Stack !!!

January 25, 2017August 14, 2018Akka, Apache Kafka, Apache Spark, Big Data and Fast Data, Cassandra, Spark, Studio-ScalaAkka, Apache Kafka, Big Data, Cassandra, Introduction, kafka, lambda-architecture, mesos, opensource, scala, smack, Streaming, technology

Reading Time: 3 minutes Hello guy’s, today’s we conduct short interview with SMACK about its architecture and there uses. Let’s start with of some introduction. Interviewer: How would you describe your self ? SMACK: I am SMACK (Spark, Mesos, Akka, Cassandra and Kafka) and belongs to all open source technologies. Mesosphere and Cisco collaboration bundles these technologies together and create a product called Infinity. Which is used to solved Continue Reading