cluster

Orchestration With Docker-Swarm

Reading Time: 6 minutes The world is constantly being attracted towards containers and its orchestration especially in large and dynamic environments which has also led to the rising of various tools and platforms in trend.Yes, we will be looking at Docker-Swarm and some of its key components !!! As we all know that Docker is a major player in the world of containers and therefore in this blog, we Continue Reading

Akka Cluster in use (Part 5): Let’s stay in touch via Gossip

Reading Time: 3 minutes In our previous blog post, Managing an Akka Cluster, we learnt how to manage an Akka Cluster via Akka Management. In this blog post, we are going to learn, how the Node(s) within an Akka Cluster communicate with each other via Gossip Let’s Gossip A very popular way to transmit a message is via Gossip 😛 . As it doesn’t need much effort and also Continue Reading

Akka Cluster in use (Part 2): Forming a Cluster

Reading Time: 3 minutes Hello friends, in our last post on Akka Cluster, we understood the purpose of an Akka Cluster. Now, next step is to understand: How to Form an Akka Cluster? But before we start forming an Akka Cluster, let us understand that: How Actors can communicate with each other over a cluster of machines (JVMs)? Now we know that each Actor in Akka has an Address. Continue Reading

Akka Cluster in use (Part 1): What is Akka Cluster?

Reading Time: 3 minutes In computer architecture, Amdahl’s law is a formula which tells us that how many times faster a program can be executed if it is parallelized. For example, if a program needs 20 hours using a single processor core, and a particular part of the program which takes one hour to execute cannot be parallelized, while the remaining 19 hours of execution time can be parallelized, Continue Reading

Scale Out with Cluster Sharding

Reading Time: 3 minutes If your actors are distributed across several nodes in the cluster, Cluster Sharding allows you to interact with them without worrying about their physical location and using only their logical identifier. Even if an actor re-locates to a new node, Akka will take care of locating it for you. You just need to send a message to it as if it is located on your local node.

Kafka Timestamp Extractor

Reading Time: 3 minutes Hi folks, I hope you all’re doing well, so if you land up here you probably looking for Timestamp Extractor for kafka streams, so whats the buzz is all about? So in this blog we are going to look what it is and would explore it as well, so buckle up. The Timestamp Extractor As per docs, A timestamp extractor extracts a timestamp from an Continue Reading

Spark – Actions and Transformations

Reading Time: 4 minutes Hey guys, welcome to series of spark blogs, this blog being the first blog in this series we would try to keep things as crisp as possible, so let’s get started. So I recently get to start learning spark about believe me and now it has made me inquisitive about it, for a brief introduction of spark, I would say that it is a pretty Continue Reading

Tale of Apache Spark

Reading Time: 6 minutes Data is being produced extensively in today’s world and it is going to be generated more rapidly in future. 90% of total data that is produced in the world is produced in last two years only and it is estimated that in 2020 world’s total data would reach 45 ZB and data generated each day would be enough that if we try to store it Continue Reading

Flinkathon: Guide to setting up a Local Flink Custer

Reading Time: 3 minutes In our previous blog post, Flinkathon: First Step towards Flink’s DataStream API, we created our first streaming application using Apache Flink. It was easy, clean, and concise. However, the real power of Apache Flink is seen on a cluster, where data is processed in a distributed manner, with the advantage of multi-core/multi-memory systems. So, in this blog post, we will see how to set up Continue Reading

Let’s create your first Grafana dashboard

Reading Time: 4 minutes In my previous blog, we discussed the setup of Grafana-Graphite for JMX monitoring.  Now we will create a first Grafana dashboard where we will create Grafana queries to visualize JMX metrics stored in Graphite. As we know, Grafana UI runs on http://localhost:3000/ by default so let’s open the URL in the browser with the default username and password which is admin: admin After login either Continue Reading

Integrating Lagom Service Discovery with Kubernetes

Reading Time: 3 minutes Consider a situation where a microservice is deployed on multiple pods and on condition one pod got restarted with any of the failure reason makes unreachable and at the same time interdependent services are registers its IP for communication. Now, since other pods of the service are alive but not able to communicate makes the communication failure as well as making the failure of every Continue Reading

Flinkathon: What makes Flink better than Kafka Streams?

Reading Time: 2 minutes Initially, I would like you all to focus on a few questions before comparing the frameworks:1. Is there any comparison or similarity between Flink and the Kafka?2. What could be better in Flink over the Kafka?3. Is it the problem or system requirement to use one over the other? Before talking about the Flink betterment and use cases over the Kafka, let’s first understand their Continue Reading