Author: Agnibhas Chattopadhyay

Spring Cloud GCP – Cloud Spanner

Reading Time: 5 minutes Spring framework is very popular and most widely used across the world. It is also one of the oldest frameworks in Java. The Spring Cloud GCP project makes the Spring Framework a first-class citizen of the Google Cloud Platform (GCP). Cloud Spanner is a fully managed relational database with unlimited scale, strong consistency, and up to 99.999% availability. It is like the big brother of Cloud Continue Reading

black samsung tablet display google browser on screen

Spring Cloud GCP- Cloud Pub/Sub Receiving Messages

Reading Time: 3 minutes This is the second blog in the series Spring Cloud GCP- Cloud Pub/Sub. If you have not gone through the first part please navigate to Spring Cloud GCP- Cloud Pub/Sub Sending Messages. In this blog, we will create an application to receive messages that are sent by the sender application that we created in the last blog. We will use Google Cloud Pub/Sub as the Continue Reading

Spring Cloud GCP- Cloud Pub/Sub Sending Messages

Reading Time: 4 minutes   Spring framework is very popular and most widely used across the world. It is also one of the oldest frameworks in Java. The Spring Cloud GCP project makes the Spring Framework a first-class citizen of the Google Cloud Platform (GCP). In this blog series, we will create an application to send messages and another for receiving messages. We will use Google Cloud Pub/Sub as Continue Reading

Apache Airflow: Understanding Operators

Reading Time: 5 minutes An Operator is the building block of an Airflow DAG. It determines what will be executed when the DAG runs. They can be considered as templates or blueprints that contain the logic for a predefined task, that we can define declaratively inside an Airflow DAG. When an operator is instantiated along with its required parameters then it is known as a task. An Operator defines one Continue Reading

Apache Airflow: Scaling Using Celery Executor

Reading Time: 4 minutes Apache Airflow is a platform to programmatically author, schedule, and monitor workflows. If you are new to Airflow, please go through my introductory blog. One of Airflow’s biggest strengths is its ability to scale. In this blog, we will find out how we can scale Airflow using executors. Overview In Airflow, even the local executor is extremely powerful as you can start scaling Airflow and Continue Reading

Data Engineering- Exploring Apache Airflow

Reading Time: 4 minutes Automating tasks play a major role in today’s industries. Automation helps us achieve our goals very quickly and with high efficiency. Yet in today’s day and age people still, fail to reap the benefits of automation. For example, in our daily lives, we deal with repetitive workflows like obtaining data, processing, uploading, and reporting. Wouldn’t it be great if this process was triggered automatically at Continue Reading

Google Cloud Platform Overview

Reading Time: 6 minutes As all of you might know, Cloud services can be broadly classified into three categories: IaaS(Infrastructure as a Service), PaaS(Platform as a Service), and SaaS(Software as a Service).  What is GCP? GCP (Google Cloud Platform) is an offering by Google that provides IaaS and PaaS services. SaaS services are also provided by Google in the form of G Suite(Google Workspace). Both G Suite and GCP Continue Reading

GCP – ‘Cloud Run’ in Seconds

Reading Time: 4 minutes As a developer, you might want to quickly deliver great cloud applications like web apps, mobile APIs, and background jobs. But choosing a cloud solution often comes with trade-offs. On the one hand, you can choose to manage your servers. But this can mean provisioning and configuring them yourself, plus worrying about scaling up and down as traffic patterns change. And you might run the Continue Reading

PDI: An Introduction to Spoon

Reading Time: 4 minutes Prerequisites: Basic knowledge about Big Data and ETL. What is PDI? PDI stands for Pentaho Data Integration. It is a tool that provides us with ETL capabilities to effectively manage huge and complex data ingestion pipelines. Its use cases include: Loading huge data sets into databases. Performing simple to complex transformations on data. Data migration between different databases. and many more… Installing PDI in your Continue Reading

Axon Part 3: Exploring The AxonIQ Initializr

Reading Time: 3 minutes Prerequisites: If you are reading this blog I assume you are already familiar with the Axon Framework basics. If not, please visit “Axon Part 1: An Introduction to Axon Framework” to get started  with Axon. Introduction: Initializers are the tools that help us start off with our project right away by automating some of the tasks which we need to go through every time we Continue Reading

Axon Part 1: An Introduction to Axon Framework

Reading Time: 3 minutes This is the first part of an ongoing series of blogs explaining Axon Framework. This blog will help you get started with axon and get a basic understanding of the same. Prerequisites Understanding Axon requires a basic knowledge of a few Axon concepts. Those are: Microservices Command Query Responsibility Segregation(CQRS) Commands, Events and Queries Domain Driven Design(DDD) Event Sourcing SAGA Design Pattern Introduction Problem: The Continue Reading

ANOTHER LOOK INTO UNIT TESTING AND INTEGRATION TESTING

Reading Time: 3 minutes Software testing is the process of verifying and validating , the developed software that works according to expectations or not. We already know that no code is perfect and completely bug-free. Also, in this fast-changing era every now and then various features are added which only increases the chances of getting bugs. Hence, the code is changed and improvised regularly to minimise the bugs, add Continue Reading