Apache Kafka

2017 – Year of FAST Data

Reading Time: < 1 minute As we approach 2017, there is a strong focus on Fast Data. This is a combination of data at rest and data in motion and the speed has to be remarkably fast. In the deck that follows, we at Knoldus present to you how we have implemented a complex multi scale solution for a large bank on the Fast Data Architecture philosophy. As we partner Continue Reading

Knoldus Partners with Confluent to Power Real Time Streams

Reading Time: 3 minutes Knoldus is pleased to announce a Consulting and System Integrator partnership with Confluent, the company founded by the creators of Apache KafkaTM Confluent, creators of the first streaming platform based on Apache KafkaTM, provides the most complete platform to build enterprise-scale streaming pipelines using Apache Kafka and simplify the development of stream processing applications. Via rapid adoption in the Fortune 500, Apache Kafka is quickly emerging as Continue Reading

Meetup: Stream Processing Using Spark & Kafka

Reading Time: < 1 minute Knoldus organized a Meetup on Friday, 9 September 2016. Topics which were covered in this meetup are: Overview of Spark Streaming. Fault-tolerance Semantics & Performance Tuning. Spark Streaming Integration with  Kafka. Meetup code sample available here Real time stream processing engine application code available here

Introduction to Kafka Connect

Reading Time: < 1 minute Knoldus organized a half an hour session on 29 July 2016 at 4:00 PM. It covers a brief introduction to Apache Kafka Connect, giving insights about the benefits of kafka connect, its use cases. It also covers the motivation behind building Kafka Connect and an introduction to its architecture. Here is the video for the same.

Building Analytics Engine Using Akka, Kafka & ElasticSearch

Reading Time: 5 minutes In this blog , I will share my experience on building scalable, distributed and fault-tolerant  Analytics engine using Scala, Akka, Play, Kafka and ElasticSearch. I would like to take you through the journey of  building an analytics engine which was primarily used for text analysis. The inputs were structured, unstructured and semi-structured data and we were doing a lot of data crunching using it. The Analytics Continue Reading

Meetup: Introduction to Apache Kafka

Reading Time: < 1 minute Knoldus organized a Meetup on Wednesday, 3 June 2016. Topics which were covered  in this meetup are 1) Overview of Kafka and Kafka ecosystem. 2)  Configuration of brokers,consumers and producers. 3) Design and motivation behind apache kafka. 4) Implementation of Consumer and Producer API. Actually, This meetup completed in to two part. In first part, We  have covered  1 to 3 points above mentioned.   Continue Reading