Author: Shivani Sarthi

data codes through eyeglasses

Way To Ship Kafka Logs To Kibana Dashboard

Reading Time: 2 minutes What are Logs? Logs are well-explanatory records of events regarding the application, its performance, and user activities. The events can include deleting, or modifying a file for the application. They also include system configuration changes. Whereas, Log files stores records about these events occurring. Since they are used for tracking information about computing events. They come in handy when it comes to identifying the problems Continue Reading

Kafka and its Important use cases

Reading Time: 3 minutes Kafka is an open-source distributed event streaming platform capable of handling trillions of events a day. It provides the messaging backbone for building distributed applications. A streaming platform needs to handle the constant influx of data. And process this data data sequentially and incrementally. It is a platform where you can publish data, or subscribe to read data. We use Kafka for building real-time data Continue Reading

What Is The Difference Between Rsync And Scp?

Reading Time: 3 minutes In this blog, we will discuss the way to transfer files among systems using SCP & Rsync with some examples. For remote copying, there are various things that needs to be taken into consideration. Like speed, security, Bandwidth, data replication etc.  Rsync Rsync is a command used for moving and synchronizing files. With this command we can manage files or directories effectively while backing up data Continue Reading

Fundamentals of ELK Stack with Demo – Part 2

Reading Time: 3 minutes The three opensource projects Elasticsearch, Logstash, and Kibana make up the ELK Stack. Now after installing ElasticSearch we will install the Logstash and Kibana. Steps to install ELK Stack Step 5- Install Kibana for ELK Now we will install Kibana next. Kibana is a visualization layer that works on top of Elasticsearch. It is a GUI for parsing and interpreting collected log files. To install Continue Reading

Fundamentals of ELK Stack with Demo – Part 1

Reading Time: 3 minutes The three opensource projects Elasticsearch, Logstash, and Kibana make up the ELK Stack. All of these are maintained by Elastic. Elasticsearch is an open source, full-text search and analysis engine. It stores the logs. Logstash is a log-aggregator, that ingests data from multiple sources. It ships, process and store logs. Kibana is a visualization layer that works on top of Elasticsearch. Elastic added another open Continue Reading

Monitoring with Grafana and it’s top alternatives

Reading Time: 3 minutes We have multiple Open Source tools for Monitoring data. Since data is something which is vast and really huge. Data monitoring saves the organization time and money. It is basically the process of proactively reviewing and evaluating the data. It helps you measure and track your data using dashboards, alerts and reports. Grafana is an open source visualization and analytics software.It is a solution for Continue Reading

Alerts in grafana, all you need to know

Reading Time: 3 minutes Grafana alerts are useful since they tell you about the problems in your system moments after they occur. Which in turn results in quickly resolving the issue. Also reducing the disruption time of the service. Main components of Alerts Alerting rule– This consists of one or more query/expression, a condition, the frequency of evaluation. Also the duration (optional) that a condition must met for the Continue Reading

text

Kafka connect and its purpose

Reading Time: 4 minutes Kafka connect is not just a free, open source component of Apache Kafka. But it also works as a centralised data hub for simple data integration between databases, key-value stores etc. The fundamental components include- Connectors Tasks Workers Converters Transforms Dead letter Queue Moreover it is a framework to stream data in and out of Apache Kafka. In addition, the confluent platform comes with many Continue Reading

Grafana- A Quick Overview

Reading Time: 2 minutes Grafana is an open source visualization and analytics software.It is a solution for running data analytics, pulling up metrics and monitor our apps with the help of dashboards.Grafana allows you to query, alert on, visualize and explore your metrics no matter wherever they are stored.It also helps us track the user behaviour , application behaviour, frequency of errors present in production or pre-prod environment etc. Continue Reading

What is CI/CD ? A FreeStyle Project Demo with Jenkins

Reading Time: 3 minutes What is CI/CD? CI /CD gave a new vision to how developers and testers produce software. In other words, the adoption of CI/CD is basically of continuous methodologies. They showcase an environment and operates around constantly integrating new code. Similar to that of the software development lifecycle. Above all starting from the waterfall, the development process changed to Agile and then to DevOps.In conclusion, CI Continue Reading

What is Headless Service? Setup a Service in Kubernetes

Reading Time: 3 minutes In the default behaviour of Kubernetes we assign as Internal IP address to the service.And with this IP address the service will proxy and load-balance the requests to the pods.We can choose which kind of service type we need while deploying it. These service types are- ClusterIP- For exposing the server on cluster-internal IP address NodePort- For exposing the service through a static port on Continue Reading