Reading Time: 3 minutes Overview: Hello everyone, in this blog, we will see an example of Kafka connect in which we will take a MySQL table, stream it to a Kafka topic, and from there load it to Elasticsearch and index its content. Installation: Now first of all we will install MySQL and Elastic search to our local system. For installing simply run: The next step is to make Continue Reading
Reading Time: 4 minutes Let us discuss something about Kafka connector and some basic fundamental of it. Before start, we need to have basic knowledge of Kafka or we can go through this Document. We’ll have a look at: What is Kafka Connect Why we need Kafka Connect/connector How kafka Connect works Source Connector Sink Connector Kafka Connector Framework Let’s how we can implement the kafka Connector framework 1- What Continue Reading
Reading Time: 3 minutes Overview: In this blog, we will be going to deep dive in with Kafka Connect and know about some basic fundamentals of it. Apache Kafka is one of the central technologies in Undertaking Models these days. More than 60% of Fortune 500 companies are utilizing Kafka. The innovation has advanced apart over the final decade i.e. from Pub/Sub to a Total Occasion Streaming Stage. Therefore, The exceptionally begins necessity to work in an occasion-driven framework is to ingest data/events. For the same reason, Kafka Interface was involved in the Kafka Biological system in 2015. This empowers us to coordinate outside frameworks without composing a Continue Reading
Reading Time: < 1 minute Hi all, Knoldus has organized a 30 min session on 1st March 2019 at 3:30 PM. The topic was Alpakka – Connecting Kafka and ElasticSearch to Akka Streams. Many people have joined and enjoyed the session. I am going to share the slides here. Please let me know if you have any question related to linked slides or video. The slides of the KnolX are here: And Continue Reading
Reading Time: 4 minutes In our previous blog, we had a look at what Akka streams are and how they are different from the other streaming mechanisms we have. In this blog, we will be taking a little step forward into the world of Akka Streams. In order to work with Akka streams, we need a mechanism to connect Akka Streams to the existing system components. That is where Alpakka Continue Reading
Reading Time: 5 minutes Couchbase and Apache Spark are best so far , for the in-memory computation. I am using akka-http because its new in the business. If you are not a big fan of akka-http and don’t think it is yet ready for production then you can take a look on this blog, which displays how to do the same task using Spray. If you are new to all Continue Reading
