Category Archives: Apache Kafka

Twitter’s tweets analysis using Lambda Architecture

Hello Folks, In this blog i will explain  twitter’s tweets analysis with lambda architecture. So first we need to understand  what is lambda architecture,about its component and usage. According to Wikipedia, Lambda architecture is a data processing architecture designed to handle … Continue reading

Posted in Akka, akka-http, Apache Kafka, apache spark, Architecture, Batch, big data, Cassandra, Scala, Spark, Streaming | 5 Comments

Kafka – Sending Object as a message

Kafka lets us publish and subscribe to streams of records and the records can be of any type, it can be JSON, String, POJO, etc. Kafka gives user the ability to creates our own serializer and deserializer so that we … Continue reading

Posted in Apache Kafka, Java | 1 Comment

Short Interview With SMACK Tech Stack !!!

Hello guy’s, today’s we conduct short interview with SMACK about its architecture and there uses. Let’s start with of some introduction. Interviewer: How would you describe your self ? SMACK: I am SMACK (Spark, Mesos, Akka, Cassandra and Kafka) and … Continue reading

Posted in Akka, Apache Kafka, apache spark, big data, Cassandra, Scala, Spark | Tagged , , , , , , , , , , , , | Leave a comment

2017 – Year of FAST Data

As we approach 2017, there is a strong focus on Fast Data. This is a combination of data at rest and data in motion and the speed has to be remarkably fast. In the deck that follows, we at Knoldus … Continue reading

Posted in Apache Kafka, Cassandra, Scala, Spark | Tagged | 3 Comments

Knoldus Partners with Confluent to Power Real Time Streams

Knoldus is pleased to announce a Consulting and System Integrator partnership with Confluent, the company founded by the creators of Apache KafkaTM Confluent, creators of the first streaming platform based on Apache KafkaTM, provides the most complete platform to build enterprise-scale … Continue reading

Posted in Apache Kafka, Scala | Tagged , , , , , | 3 Comments

Meetup: Stream Processing Using Spark & Kafka

Knoldus organized a Meetup on Friday, 9 September 2016. Topics which were covered in this meetup are: Overview of Spark Streaming. Fault-tolerance Semantics & Performance Tuning. Spark Streaming Integration with  Kafka. Meetup code sample available here Real time stream processing … Continue reading

Posted in Apache Kafka, apache spark, Best Practices, big data, Elasticsearch, Scala, Spark, Streaming | 1 Comment

Introduction to Kafka Connect

Knoldus organized a half an hour session on 29 July 2016 at 4:00 PM. It covers a brief introduction to Apache Kafka Connect, giving insights about the benefits of kafka connect, its use cases. It also covers the motivation behind … Continue reading

Posted in Apache Kafka, Scala | Tagged , , , | Leave a comment

Building Analytics Engine Using Akka, Kafka & ElasticSearch

In this blog , I will share my experience on building scalable, distributed and fault-tolerant  Analytics engine using Scala, Akka, Play, Kafka and ElasticSearch. I would like to take you through the journey of  building an analytics engine which was primarily … Continue reading

Posted in Akka, akka-http, Amazon, Amazon EC2, Apache Kafka, Architecture, AWS, AWS Services, Batch, Best Practices, big data, Cassandra, database, Elasticsearch, Java, Non-Blocking, NoSql, Reactive, S3, Scala, Streaming, Web | 9 Comments

Meetup: Introduction to Apache Kafka

Knoldus organized a Meetup on Wednesday, 3 June 2016. Topics which were covered  in this meetup are 1) Overview of Kafka and Kafka ecosystem. 2)  Configuration of brokers,consumers and producers. 3) Design and motivation behind apache kafka. 4) Implementation of … Continue reading

Posted in Apache Kafka, Scala | Tagged , | Leave a comment