Knoldus Blogs

Lagom: Lets Stream Kafka Messages And Process using Akka Actor

June 1, 2020October 14, 2020Akka, akka-streams, Apache Kafka, Big Data and Fast Data, Microservices, Studio-Scalaconsming messages from kafka using lagom, kafka lagom integration

Reading Time: 5 minutes Lagom is an opensource framework for building reactive applications using Java or Scala and it is built on Akka and Play, which are well-known technologies performing in production in some of the most performance-centric and scalable application systems. The Lagom has been continuously proving itself as a user-friendly and convenient framework to design and develop scalable microservices. However, the microservices can either based on orchestration, Continue Reading

Akka-gRPC

May 14, 2020Akka, akka-http, akka-streams, Grpc, Studio-Scala

Reading Time: 3 minutes Akka gRPC provides support for building streaming gRPC servers and clients on top of Akka Streams and Akka Http. Features of Akka-gRPC A generator, that starts from a protobuf service definitions, for: Model classes The service API as a Scala trait using Akka Stream Sources On the server side code to create an Akka HTTP route based on your implementation of the service On the client side, a client for the Continue Reading

Akka-Streams: All About Graphs!

May 6, 2020May 6, 2020Akka, akka-streams, Big Data and Fast Data, Studio-Scalaakka-streaming, akka-streams, Graphs, Graphs-in-akka, PartialGraphs

Reading Time: 4 minutes In my previous blogs, I discussed about the basics of akka-streams and materialization. Now let’s dig deeper into Graphs in Akka-Streams. Graphs Till now we know how to create a linear pipeline/linear graph. But in real life scenario we generally don’t have linear graphs to implement. The graphs can be complex. In Akka Streams computation graphs are written in a more graph-resembling DSL. It aims Continue Reading

Akka-Streams: All About Materialization!

May 6, 2020October 12, 2020Akka, akka-streams, Big Data and Fast Data, Studio-ScalaAkka, Akka Streams, akka-streams, fusion, materialization

Reading Time: 4 minutes In my previous blog, I discussed about the basics of akka-stream. Basically, it was an introduction to akka-stream to get you started. There I mentioned about materialization which is a really important concept in Akka-Streams. And in this blog I’m going to discuss about it and some related topics in detail. So, let’s begin ! Akka-Streams Basics Let’s revisit the basics first. So, the data Continue Reading

Getting Started with Akka-Streams

May 6, 2020May 6, 2020Akka, akka-streams, Big Data and Fast Data, Studio-ScalaAkka, Akka actor, akka-streams, scala, Streams

Reading Time: 4 minutes As the world is growing, so is the data. And analysis of this data has become important. But how will you do it? How will you work with the data whose size is unknown to you? A solution to this scenario is Akka-Streams and here I’m going to discuss it. In this blog you will get to know the basics of Akka-Streams just to get Continue Reading

Streaming data from Cassandra using Alpakka

September 3, 2019September 3, 2019Akka, akka-streams, Cassandra, Microservices, Streaming, Streaming Solutions, Studio-Scalaalpakka cassandra, alpakka cassandra connector, cassandra alpakka

Reading Time: 7 minutes Alpakka project is an open-source initiative to implement stream aware and reactive pipelines using Java and Scala which is built on top of Akka streams and specially designed to provide a DSL for reactive and stream-oriented programming with built-in support for backpressure to avoid the flood of data. As a reference, Akka streams supports reactive streams and JDK 9+ compliant implementation and therefore fully interoperable Continue Reading

Knolx: Alpakka-Connecting Kafka & ElasticSearch to Akka Streams

May 1, 2019June 19, 2019Akka, akka-streams, Apache Kafka, Elasticsearch, Streaming, Studio-Scalaakka-streams, alpakka, connector, elasticsearch, kafka, reactive streams, Streams

Reading Time: < 1 minute Hi all, Knoldus has organized a 30 min session on 1st March 2019 at 3:30 PM. The topic was Alpakka – Connecting Kafka and ElasticSearch to Akka Streams. Many people have joined and enjoyed the session. I am going to share the slides here. Please let me know if you have any question related to linked slides or video. The slides of the KnolX are here: And Continue Reading

Reactivate your streams with Reactive Streams!!

March 5, 2019March 5, 2019akka-streams, Reactive Application, Streaming, Streaming Solutions, Studio-ScalaAsynchronous, backpressure, Reactive Manifesto, reactive streams, Streams

Reading Time: 5 minutes As you all might have known by now that one of the hot topics for quite some time has been streaming of big data. Day after day, we see tons of streaming technologies out there competing with one another. The obvious reason for that, processing big volumes of data is not enough. We need real-time processing of data, especially when we need to handle continuously increasing Continue Reading

Akka Stream: Map And MapAsync

March 3, 2019March 3, 2019Akka, akka-streams, Future, map, mapAsync, Studio-Scala

Reading Time: 2 minutes In this blog, we will discuss what are “map” and “mapAsync” when used in the Akka stream and how to use them. The difference is highlighted in their signatures:- Flow.map takes in a function that returns a type T, while Flow.mapAsync takes in a function that returns a type Future[T]. Let’s take one practical example to understand both:- Problem – Suppose we have a user with a userId and Continue Reading

Want to expose an API? Reactive Options

February 6, 2019February 6, 2019Akka, akka-streams, Architecture, Big Data and Fast Data, Business Insights, Reactive Programming, Studio-Scala

Reading Time: 3 minutes In the modern digital world, a system which cannot talk to other systems or does not allow other systems to talk to itself is bound to fail. A lot of organizations that we work with be it large banks, healthcare institutions, travel booking and predictions, industrial analysers, would like to expose their ecosystem through an API so that it is available as a platform for other companies and products to consume and innovate on.

Alpakka – Connecting Kafka and ElasticSearch to Akka streams

November 12, 2018November 12, 2018Akka, akka-streams, Apache Kafka, Elasticsearch, Streaming, Studio-Scalaakka-streams, alpakka, connector, elasticsearch, kafka, Streams

Reading Time: 4 minutes In our previous blog, we had a look at what Akka streams are and how they are different from the other streaming mechanisms we have. In this blog, we will be taking a little step forward into the world of Akka Streams. In order to work with Akka streams, we need a mechanism to connect Akka Streams to the existing system components. That is where Alpakka Continue Reading

Akka Streams: Is it a Solution to Your Streaming Problems?

October 16, 2018October 16, 2018Akka, akka-streams, Java, Streaming, Streaming Solutions, Studio-ScalaAkka actor, akka-streaming, broadcasting, Data Flow Graphs, scala, Streams

Reading Time: 6 minutes A few days earlier, in our project, we were using Spark streaming and initially, it worked like a charm. But as we were very close to completion of our use case, the unexpected occurred. Spark does have a lot of interesting features, but we had some more custom needs such as running a ton of varying jobs with different actors/flows. Also, we needed something which Continue Reading

Introduction to Akka Streams – Part 1

October 15, 2018October 16, 2018Akka, akka-streams, Studio-ScalaAkka actor, akka-streams, back2basics, Getting Started

Reading Time: 4 minutes Akka Streams is a library that is used to process and transform a stream of data. In this blog, I’ll be discussing the components of Akka Streams. Akka Streams is an implementation of Reactive Streams and uses bounded buffer space, and this property is known as boundedness. To use Akka Streams, add the below dependency in your build.sbt: