cluster

integrating Cucumber with Akka-Http

Akka Cluster in use (Part 9): Effectively Resolving Split Brain Problem

Reading Time: 7 minutes We can deal with cluster failures manually, as mentioned in our blog post Manually Healing an Akka Cluster. However, it requires a DevOps engineer to be available 24 x 7. This process is very expensive and can be very frustrating (sometimes). Hence, we really need a way via which we can resolve cluster failures in an automated fashion. This is where a Split Brain Resolver Continue Reading

integrating Cucumber with Akka-Http

Akka Cluster in use (Part 8): What is a Split Brain?

Reading Time: 5 minutes In our previous blog post, Manually Healing an Akka Cluster, we have already seen that if we do not handle the failures in an Akka Cluster carefully, then it can lead to disastrous situations like Split Brain. Hence, in this blog post we will learn more about the consequences of the Split Brain problem. What is Split Brain? Split Brain is a destructive condition of Continue Reading

Akka Cluster in use (Part 7): Manually Healing an Akka Cluster

Reading Time: 4 minutes In our previous blog post, Understanding Failures in Akka Cluster, we came to know how an Akka Cluster reacts in case of a failure and what are the reasons behind the failures. Now, whenever a failure will occur in an Akka Cluster, we would need a way to heal the cluster, so that we can restore it back to its normal working condition. Hence, in Continue Reading

Akka Cluster in use (Part 6): Understanding Failures in Akka Cluster

Reading Time: 4 minutes Ideally we would never want our Akka Cluster(s) to fail. Instead we would like to keep them running in a perfect condition. But in real world failures are unavoidable and can be of many types. Like network failures, application failures, and many more. So let’s understand how an Akka Cluster reacts in case of a failure and what are the reasons behind the failures. Changes Continue Reading

Orchestration With Docker-Swarm

Reading Time: 6 minutes The world is constantly being attracted towards containers and its orchestration especially in large and dynamic environments which has also led to the rising of various tools and platforms in trend.Yes, we will be looking at Docker-Swarm and some of its key components !!! As we all know that Docker is a major player in the world of containers and therefore in this blog, we Continue Reading

Akka Cluster in use (Part 5): Let’s stay in touch via Gossip

Reading Time: 3 minutes In our previous blog post, Managing an Akka Cluster, we learnt how to manage an Akka Cluster via Akka Management. In this blog post, we are going to learn, how the Node(s) within an Akka Cluster communicate with each other via Gossip Let’s Gossip A very popular way to transmit a message is via Gossip 😛 . As it doesn’t need much effort and also Continue Reading

Akka Cluster in use (Part 2): Forming a Cluster

Reading Time: 3 minutes Hello friends, in our last post on Akka Cluster, we understood the purpose of an Akka Cluster. Now, next step is to understand: How to Form an Akka Cluster? But before we start forming an Akka Cluster, let us understand that: How Actors can communicate with each other over a cluster of machines (JVMs)? Now we know that each Actor in Akka has an Address. Continue Reading

Akka Cluster in use (Part 1): What is Akka Cluster?

Reading Time: 3 minutes In computer architecture, Amdahl’s law is a formula which tells us that how many times faster a program can be executed if it is parallelized. For example, if a program needs 20 hours using a single processor core, and a particular part of the program which takes one hour to execute cannot be parallelized, while the remaining 19 hours of execution time can be parallelized, Continue Reading

Scale Out with Cluster Sharding

Reading Time: 3 minutes If your actors are distributed across several nodes in the cluster, Cluster Sharding allows you to interact with them without worrying about their physical location and using only their logical identifier. Even if an actor re-locates to a new node, Akka will take care of locating it for you. You just need to send a message to it as if it is located on your local node.

Kafka Timestamp Extractor

Reading Time: 3 minutes Hi folks, I hope you all’re doing well, so if you land up here you probably looking for Timestamp Extractor for kafka streams, so whats the buzz is all about? So in this blog we are going to look what it is and would explore it as well, so buckle up. The Timestamp Extractor As per docs, A timestamp extractor extracts a timestamp from an Continue Reading

Spark – Actions and Transformations

Reading Time: 4 minutes Hey guys, welcome to series of spark blogs, this blog being the first blog in this series we would try to keep things as crisp as possible, so let’s get started. So I recently get to start learning spark about believe me and now it has made me inquisitive about it, for a brief introduction of spark, I would say that it is a pretty Continue Reading

Tale of Apache Spark

Reading Time: 6 minutes Data is being produced extensively in today’s world and it is going to be generated more rapidly in future. 90% of total data that is produced in the world is produced in last two years only and it is estimated that in 2020 world’s total data would reach 45 ZB and data generated each day would be enough that if we try to store it Continue Reading