Services

Go to Overview

 High performance systems Data strategy & Analytics Intelligence Driven Decisioning Platform strategy Blockchain Expert Services Academy, Audit & Consulting

Accelerators

Go to Overview

Platforms

KDP KDSP

Products

PremonR CodeSquad Studio9

TechHub

Akka Scala Rust Spark Functional Java Kafka Flink ML/AI DevOps Data Warehouse

Industries

Go to Overview

Travel

Retail Finance Healthcare Media and Publishing Consumer Internet Hi-tech & IOT

Insights

Go to Overview

 Case Studies Blogs Books Conferences & Events Resources OS contributions Webinars Knolx
CONTACT US

akka-streams

Building Stateful Systems with Akka Cluster Sharding

Building Stateful Systems with Akka Cluster Sharding

Akka, akka-streams, cluster, Tech Blogs

Reading Time: 5 minutes This post was written in collaboration with Lightbend, a Knoldus’ Partner. Most microservices applications are stateless, which means they delegate persistence and consistency to a database or external storage. But sometimes there’s a benefit to keeping state inside the application.  If you’ve worked with data storage systems long enough, you are bound to bump into the term “sharding“. Sharding is another word for partitioning and Continue Reading

Introduction to Scanamo Version – 1.0.0-M11

Akka, akka-streams, Scala,

Reading Time: 2 minutes Scanamo Scanamo is a library to make use of DynamoDB with Scala. In this blog, we are going to work on latest version 1.0.0-M11 So, let’s get it started- 1. Add Library Dependencies: – Setup sbt project and add these library dependencies 2. Setup application.conf: – Create application.conf file and place it inside the src\main\resources\ 3. Create Case Class And DAO: – Create case class Continue Reading

Introduction to Alpakka DynamoDB

Akka, akka-streams, Scala, ,

Reading Time: 3 minutes Alpakka DynamoDB This AWS DynamoDB connector provides a flow for streaming DynamoDB requests, using Akka stream and AWS java DynamoDB SDK. And in this blog, we are going to work on version 1.1.2 So, let’s get it started- 1. Add Library Dependencies: – Setup sbt project and add these library dependencies in build.sbt 2. Setup application.conf: – Create application.conf file and place it inside the Continue Reading

Comparison between different streaming engines

akka-streams, Apache Flink, Apache Kafka, Apache Spark, Big Data and Fast Data, Scala, Spark, , , , , , ,

Reading Time: 5 minutes Distributed stream processing engines have been on the rise in the last few years, first Hadoop became popular as a batch processing engine, then focus shifted towards stream processing engines. Stream processing engines can make the job of processing data that comes in via a stream easier than ever before and by using clustering can enable processing data in larger sets in a timely manner. Continue Reading

Alpakka : Creating Data Pipelines

Akka, akka-streams, Big Data and Fast Data, Scala, Tech Blogs, , , , , , , , , ,

Reading Time: 4 minutes In my previous blogs I discussed about akka-streams , materialization and graphs in akka-stream . It was so easy to create sources, sinks and flows and connect them using methods and create runnable graphs. Now consider a situation where I’m getting data from Kafka and want to push it in Cassandra or Elasticsearch ? How to create such source or flow or sink that can Continue Reading

Alpakka: Process big CSV files using Akka Streams

akka-streams, Big Data and Fast Data, Future, Scala

Reading Time: 3 minutes In this big data world, we have lots of data, and generally, that data comes in CSV files. So as the data is huge, so the CSV files will also be huge. It will not be feasible to load that CSV file into memory in one go. So here the challenge comes, that how should we read those big CSVs. I got the same use Continue Reading

Lagom: Lets Stream Kafka Messages And Process using Akka Actor

Akka, akka-streams, Apache Kafka, Big Data and Fast Data, Microservices, Scala,

Reading Time: 5 minutes Lagom is an opensource framework for building reactive applications using Java or Scala and it is built on Akka and Play, which are well-known technologies performing in production in some of the most performance-centric and scalable application systems. The Lagom has been continuously proving itself as a user-friendly and convenient framework to design and develop scalable microservices. However, the microservices can either based on orchestration, Continue Reading

Akka-gRPC

Akka, akka-http, akka-streams, Grpc, Scala

Reading Time: 3 minutes Akka gRPC provides support for building streaming gRPC servers and clients on top of Akka Streams and Akka Http. Features of Akka-gRPC A generator, that starts from a protobuf service definitions, for: Model classes The service API as a Scala trait using Akka Stream Sources On the server side code to create an Akka HTTP route based on your implementation of the service On the client side, a client for the Continue Reading

Akka-Streams: All About Graphs!

Akka, akka-streams, Big Data and Fast Data, Scala, , , ,

Reading Time: 4 minutes In my previous blogs, I discussed about the basics of akka-streams and materialization. Now let’s dig deeper into Graphs in Akka-Streams. Graphs Till now we know how to create a linear pipeline/linear graph. But in real life scenario we generally don’t have linear graphs to implement. The graphs can be complex. In Akka Streams computation graphs are written in a more graph-resembling DSL. It aims Continue Reading

Akka-Streams: All About Materialization!

Akka, akka-streams, Big Data and Fast Data, Scala, , , ,

Reading Time: 4 minutes In my previous blog, I discussed about the basics of akka-stream. Basically, it was an introduction to akka-stream to get you started. There I mentioned about materialization which is a really important concept in Akka-Streams. And in this blog I’m going to discuss about it and some related topics in detail. So, let’s begin ! Akka-Streams Basics Let’s revisit the basics first. So, the data Continue Reading

Getting Started with Akka-Streams

Akka, akka-streams, Big Data and Fast Data, Scala, , , ,

Reading Time: 4 minutes As the world is growing, so is the data. And analysis of this data has become important. But how will you do it? How will you work with the data whose size is unknown to you? A solution to this scenario is Akka-Streams and here I’m going to discuss it. In this blog you will get to know the basics of Akka-Streams just to get Continue Reading

Streaming data from Cassandra using Alpakka

Akka, akka-streams, Cassandra, Microservices, Scala, Streaming, Streaming Solutions, ,

Reading Time: 7 minutes Alpakka project is an open-source initiative to implement stream aware and reactive pipelines using Java and Scala which is built on top of Akka streams and specially designed to provide a DSL for reactive and stream-oriented programming with built-in support for backpressure to avoid the flood of data. As a reference, Akka streams supports reactive streams and JDK 9+ compliant implementation and therefore fully interoperable Continue Reading

Knolx: Alpakka-Connecting Kafka & ElasticSearch to Akka Streams

Akka, akka-streams, Apache Kafka, Elasticsearch, Scala, Streaming, , , , , ,

Reading Time: < 1 minute Hi all, Knoldus has organized a 30 min session on 1st  March 2019 at 3:30 PM. The topic was Alpakka – Connecting Kafka and ElasticSearch to Akka Streams.  Many people have joined and enjoyed the session. I am going to share the slides here. Please let me know if you have any question related to linked slides or video. The slides of the KnolX are here: And Continue Reading

OUR OFFERINGS

High Performace System Data Strategy & Analytics Intelligence Driven Decisioning Platform Strategy Blockchain Expert Services Academy, Audit & Consulting KDP KDSP PremonR

COMPANY

About Knoldus Knolway Case Studies Testimonials Careers Tech Expertise Conferences and Events News Room Our Partners CSR

LEARN

Why Knoldus? Blog Resources KnolX Webinars and Videos Podcast Rust Times Innovation Labs Knoldus Tech Hub Open Source Contributions

CONNECT

Contact Us Engagement Model Follow us Here:
Subscribe to our newsletter

Partners

lightbend
databricks
confluent
docker
hashicorp
ibm
© 2020 Knoldus Inc. All Rights Reserved.
Privacy Policy | Sitemap