akka-streams

Comparing Data Streaming Frameworks | Scala

Reading Time: 4 minutes In this Era of Technology, where the amount of data is growing exponentially and every bit of data holds value. Even, according to some reports, the number of bytes being generated and stored till now in the world has already exceeded the star counts in the sky. As every bit is useful so, it is very important to store them without losing any bit. When Continue Reading

Akka Streams | Three Basic Components

Reading Time: 3 minutes Akka, a free open source toolkit simplifying the construction of concurrent and distributed system/application. We have already deal with Akka Actors where we learnt about the Akka Actors and their Behaviors. But Actors can be seen dealing with with Sequence of Data where they send or receive series of messages. So, In this blog we discuss Akka Stream in bit detail. What is Akka Streams Continue Reading

Understanding Akka Streams and Its Components

Reading Time: 4 minutes Overview In this blog, we’ll be understand about akka streams and its components. Also, we’ll do a simple exercise that involves each of these components. Introduction Stream A stream is a flow of data that involves moving and transforming data. An element is the processing unit of the stream. Akka Streams In software development, there can be cases where we need to handle the potentially Continue Reading

Introduction to Akka Streams

Reading Time: 4 minutes Hey folks, let us understand the basics of akka streams. I hope you have a basic understanding of Akka Actor. What is Akka Streams Akka Streams is a library to process and transfer a sequence of elements. It is built on top of Akka Actors to make the ingestion and processing of streams easy. As it is build on top of Akka Actors, it provide Continue Reading

Backpressure in Akka Stream

Reading Time: 4 minutes “Reactive Streams” — whenever we come across these words, there are two things that come to our mind. The first is asynchronous stream processing, and the second is non-blocking backpressure. In this blog, we are going to learn about the latter part. Understanding Backpressure Very simply put, the idea behind backpressure is the ability to say “hey slow down!”. Let’s start with an example that Continue Reading

Building Stateful Systems with Akka Cluster Sharding

Building Stateful Systems with Akka Cluster Sharding

Reading Time: 5 minutes This post was written in collaboration with Lightbend, a Knoldus’ Partner. Most microservices applications are stateless, which means they delegate persistence and consistency to a database or external storage. But sometimes there’s a benefit to keeping state inside the application.  If you’ve worked with data storage systems long enough, you are bound to bump into the term “sharding“. Sharding is another word for partitioning and Continue Reading

Introduction to Scanamo Version – 1.0.0-M11

Reading Time: 2 minutes Scanamo Scanamo is a library to make use of DynamoDB with Scala. In this blog, we are going to work on latest version 1.0.0-M11 So, let’s get it started- 1. Add Library Dependencies: – Setup sbt project and add these library dependencies 2. Setup application.conf: – Create application.conf file and place it inside the src\main\resources\ 3. Create Case Class And DAO: – Create case class Continue Reading

Introduction to Alpakka DynamoDB

Reading Time: 3 minutes Alpakka DynamoDB This AWS DynamoDB connector provides a flow for streaming DynamoDB requests, using Akka stream and AWS java DynamoDB SDK. And in this blog, we are going to work on version 1.1.2 So, let’s get it started- 1. Add Library Dependencies: – Setup sbt project and add these library dependencies in build.sbt 2. Setup application.conf: – Create application.conf file and place it inside the Continue Reading

Comparison between different streaming engines

Reading Time: 5 minutes Distributed stream processing engines have been on the rise in the last few years, first Hadoop became popular as a batch processing engine, then focus shifted towards stream processing engines. Stream processing engines can make the job of processing data that comes in via a stream easier than ever before and by using clustering can enable processing data in larger sets in a timely manner. Continue Reading

Alpakka : Creating Data Pipelines

Reading Time: 4 minutes In my previous blogs I discussed about akka-streams , materialization and graphs in akka-stream . It was so easy to create sources, sinks and flows and connect them using methods and create runnable graphs. Now consider a situation where I’m getting data from Kafka and want to push it in Cassandra or Elasticsearch ? How to create such source or flow or sink that can Continue Reading

Alpakka: Process big CSV files using Akka Streams

Reading Time: 3 minutes In this big data world, we have lots of data, and generally, that data comes in CSV files. So as the data is huge, so the CSV files will also be huge. It will not be feasible to load that CSV file into memory in one go. So here the challenge comes, that how should we read those big CSVs. I got the same use Continue Reading

Lagom: Lets Stream Kafka Messages And Process using Akka Actor

Reading Time: 5 minutes Lagom is an opensource framework for building reactive applications using Java or Scala and it is built on Akka and Play, which are well-known technologies performing in production in some of the most performance-centric and scalable application systems. The Lagom has been continuously proving itself as a user-friendly and convenient framework to design and develop scalable microservices. However, the microservices can either based on orchestration, Continue Reading

Akka-gRPC

Reading Time: 3 minutes Akka gRPC provides support for building streaming gRPC servers and clients on top of Akka Streams and Akka Http. Features of Akka-gRPC A generator, that starts from a protobuf service definitions, for: Model classes The service API as a Scala trait using Akka Stream Sources On the server side code to create an Akka HTTP route based on your implementation of the service On the client side, a client for the Continue Reading