Knoldus Blogs

Airbyte OSS Metrics in Prometheus

July 5, 2022July 8, 2022Studio-Scala#prometheus, GCP services, grafana

Reading Time: 4 minutes Airbyte is a fast-growing ELT tool that helps acquire data from multiple sources. Particularly useful in building data lakes. Airbyte offers pre-built connectors to over 300 sources and 10s of destinations and also allows custom connectors to be built quickly using language SDKs. Airbyte recently released Opentelemetry-based metrics, however, the documentation has been spotty and incomplete. You can check it out here. In this blog, Continue Reading

Monitoring Elastic Search using Prometheus and Grafana.

December 13, 2021December 13, 2021Elasticsearch, Monitoring, Prometheus, Studio-DevOps#prometheus, Devops, Elastic search, grafana

Reading Time: 4 minutes This Article will guide you to Monitor Elastic Search using Prometheus and Grafana in Kubernetes. Before Going deep in this topic, First of all let’s understand what are these. Elastic Search: Elasticsearch is a distributed, free and open search and analytics engine for all types of data, including textual, numerical, geospatial, structured, and unstructured. Here i believe you have knowledge of setting up elastic search Continue Reading

Audit DC/OS Service via Prometheus/Filebeat

April 13, 2021April 13, 2021DCOS, Security Audit, Studio-DevOps, Tech Blogs, Tutorial#filebeat, #prometheus, Audit, dc/os services, Monitoring, service-audit

Reading Time: 3 minutes In our previous blog post, How to audit DC/OS Services?, we learned how to locally audit service/app in DC/OS via dcos-adminrouter.service. This blog is in continuation of the previous one and here we will explore how we can audit DC/OS Service via Prometheus /Filebeat. Quick Recap We have seen that DC/OS doesn’t provides any web interface is to track the change in service/app configs , Continue Reading

Linking Logs to Grafana Panels using Loki

June 16, 2020June 16, 2020Monitoring, Studio-DevOps, Studio-Scala#grafana, #loki, #prometheus, #promtail

Reading Time: 4 minutes Hi folks, in this blog, we will be discussing what challenges we face when we want to view logs with respect to metrics and how we can achieve this using Grafana, Loki, and Promtail. Problem Statement When using monitoring solutions like Grafana, Prometheus, Elatic Stack etc for our infrastructure, we have metrics and logs decoupled to an extent that it is very difficult to look Continue Reading

Transport Cinnamon Matrices From Lagom To Prometheus

September 4, 2018Architecture, cluster, Lagom, Monitoring, Studio-Scala, Telemetry#Cinnamon, #prometheus, #telemetry, lagom, Monitoring

Reading Time: 3 minutes Monitoring is a pain when it comes to distributed applications, and even more when you have shared or non-shared variables to monitor in your application. Here in this blog, I’ll explain two tools which can ease the monitoring efforts, one for generating metrics called Cinnamon and other to visualize them, called Prometheus. Let’s have a quick brief intro about these two – Prometheus – An open-source monitoring system with Continue Reading