Running Apache Airflow DAG with Docker

Reading Time: 3 minutes In this blog, we are going to run the sample dynamic DAG using docker. Before that, let’s get a quick idea about the airflow and some of its terms. What is Airflow? Airflow is a workflow engine which is responsible for managing and scheduling running jobs and data pipelines. It ensures that the jobs are ordered correctly based on dependencies and also manages the allocation Continue Reading

Simple CI/CD Pipeline Using Jenkins

Reading Time: 5 minutes In this blog we gone a see creating a CI/CD Pipeline using Jenkins. Some pre-requisites to create a CI/CD pipeline using Jenkins are. Open-JDK-8 Jenkins installed on our system At the very first we see a little bit introduction of Jenkins and why we need Jenkins Pipeline. Jenkins Jenkins is an open-source automation tool to create a continuous integration pipeline. It is used to building Continue Reading

Glimpse of Pipeline in Jenkins

Reading Time: 3 minutes Hi readers, In this blog, we will be creating the Sample Jenkins pipeline also we will be looking at basic syntax of the pipeline. Jenkins Pipeline is a suite of plugins that supports implementing and integrating continuous delivery pipelines into Jenkins. A continuous delivery (CD) pipeline is an automated expression of your process for getting software from version control right through to your users and customers. Let’s get started Continue Reading

Defining your workflow: Why Not Airflow?

Reading Time: 4 minutes What is Apache Airflow? Airflow is a platform to programmatically author, schedule & monitor workflows or data pipelines. These functions achieved with Directed Acyclic Graphs (DAG) of the tasks. It is an open-source and still in the incubator stage. It was initialized in 2014 under the umbrella of Airbnb since then it got an excellent reputation with approximately 800 contributors on GitHub and 13000 stars. Continue Reading

Jenkins File: The A B C …

Reading Time: 5 minutes Jenkins came with a big bang. That said, it enhanced the whole process of continuous integration & continuous deployment. The challenge that a dev faces is to deliver the most updated and safe code to the customer. The advent of CD(continuous deployment) pipeline automates expression of the process to get the software from the version control system directly to the user. This expression, which does Continue Reading