cluster

black laptop computer turned on showing computer codes

๐†๐จ๐จ๐ ๐ฅ๐ž ๐Š๐ฎ๐›๐ž๐ซ๐ง๐ž๐ญ๐ž๐ฌ ๐„๐ง๐ ๐ข๐ง๐ž (GKE) – Deploy an Application to the Cluster

Reading Time: 3 minutes Introduction to Kubernetes Kubernetes is an open-source container orchestration platform (Originally developed by Google) designed to automate the deployment, scaling, and management of containerized applications. Kubernetes makes it easy to deploy and operate applications in a microservice architecture.  What is GKE? Google Kubernetes Engine is a Management and orchestration way for Containers. The goal of GKE is to increase the potency of DevOps and development teams by comprising Continue Reading

Understanding Services in Kubernetes with Examples!

Reading Time: 4 minutes What is Service? Service is an abstraction level that Kubernetes uses to make a deployed application accessible from the internal and external of the cluster. Think time… Imagine that, you have been asked to deploy a web app How front-end web app is exposed to the outside world ? In what way will we connect front-end with back-end and database? How do we resolve Pod IP Continue Reading

Install/Configure Hadoop HDFS,YARN Cluster and integrate Spark with it

Reading Time: 5 minutes In our current scenario, we have 4 Node cluster where one is master node (HDFS Name node and YARN resource manager) and other three are slave nodes (HDFS data node and YARN Node manager) In this cluster, we have implemented Kerberos, which makes this cluster more secure. Kerberos services are already running in the different server which would be treated as KDC server. In all Continue Reading

Kafka

Set-up Kafka Cluster using Kubernetes Statefulset

Reading Time: 3 minutes Hi readers, In this blog, we will be setting up a Kafka Statefulset cluster using Kubernetes and also get a basic knowledge of Statefulset. StatefulSet StatefulSet is the workload API object used to manage stateful applications. Manages the deployment and scaling of a set of Pods, and provides guarantees about the ordering and uniqueness of these Pods. Kafka Apache Kafka is an open-source stream-processing software platform developed by Continue Reading

DC/OS Installation experience on Local Cluster

Reading Time: 4 minutes Recently got the task to install DC/OS on our local cluster. Previously I used AWS to install DC/OS, but this time I had to do everything on our own, from installing CentOS to creating the DC/OS cluster. With this blog, I am going to share my experience that I faced in installing DC/OS. It took almost three days, but at the end I successfully installed Continue Reading

Cinnamon: Way For Monitoring & Metrics Generation for Akka ActorSystem

Reading Time: 2 minutes We are developing huge applications and deployed on multiple virtual machines and clusters. For monitoring applications, we need to enable logs into our application and analysis that logs with help of some tools like elastic stack. But !! what if we need to check health of application on virtual machines and clusters? For that, we are using several Metrics for system health check like Gauges, Continue Reading

Deploy a Spark Application on Cluster

Reading Time: 2 minutes In one of our previous blog, Setup a Apache Spark Cluster in your Single Standalone Machine, we showed how to setup a standalone cluster for running spark applications. But we never discussed on how to deploy our Spark applications on that cluster.ย So, in thisย blog, we will see how to deploy our Spark application on a cluster and use it to run our spark jobs. For Continue Reading