Amazon

Terraform: Enabling developer to create and manage deployment through code

Reading Time: 2 minutes In this blog post, We will walk you through Terraform which is a tool for building, changing, and versioning infrastructure safely and efficiently. Terraform enables the developers to properly manage the infrastructure through code. The set of files used to describe infrastructure in Terraform is simply known as a Terraform configuration. These files have extension .tf. Configuration files describe to Terraform the components needed to Continue Reading

Dealing With Deltas In Amazon Redshift

Reading Time: 5 minutes Hi, In this blog I would like to discuss a scenario of implementation of Deltas in Amazon Redshift using spark-redshift. Prior to that I would like to make you aware of Amazon Redshift, spark-redshift library and integration of Spark with Redshift. It is assumed that you have a fair knowledge of programming in Apache Spark and Spark SQL. You may refer to the documentation links Continue Reading

Serverless Architecture-Blog-2 (AWS Lambda)

Reading Time: 3 minutes In our last blog, we have seen the serverless introduction, Continuing that in this blog we will implement serverless using AWS lambda. AWS Lambda is a compute service that lets you run code without provisioning or managing servers. AWS Lambda executes your code only when needed and scales automatically, from a few requests per day to thousands per second.

Serverless Architecture – Blog-1

Reading Time: 2 minutes What is Serverless computing? The “serverless” bit doesn’t actually mean that there are no servers required to run the new feature. It just means that we don’t have to deal with the infrastructure.That means we don’t have to worry about scaling, multi-server communication and other problems related to distributed systems. Lambdas do everything for us! Serverless can also mean applications where some amount of server-side Continue Reading

Mounting EBS(Elastic Block Store) volume to EC2(Elastic Compute Cloud) instance.

Reading Time: 3 minutes In this blog we will consider simple steps by which we can attach and mount a volume(elastic block store) to an ec2 instance. Following steps must be followed : Step 1 -> Creating an ec2 instance We will be creating a Linux instance (m4.large) which comes with Cent OS as the default operating system. Steps of creating an instance are clearly mentioned in official amazon docs, Continue Reading

AWS | Cleaning up your Amazon ECS resources

Reading Time: 3 minutes In my previous blog posts on AWS (Introduction to Amazon ECS | Launch Amazon ECS cluster | Scaling with Amazon ECS | Deploy updated Task definition/Docker image), I had given an overview about what is Amazon ECS with a walk-through on how to launch Amazon ECS and then deploy sample app by creating a task definition, scheduling tasks and configuring a cluster and to scale Continue Reading

AWS | Amazon ECS – Deploy Updated Task Definition/Docker Images

Reading Time: 3 minutes In my previous blog posts on AWS (Launch Amazon ECS cluster and scaling with Amazon ECS), I had explained how to deploy sample app by creating a task definition, scheduling tasks and configuring a cluster on Amazon ECS and to scale in / scale out the same. In this I will guide you how to create a new revision for the existing task definition to use Continue Reading

AWS | Scaling with Amazon ECS

Reading Time: 3 minutes In my last post regarding AWS, I had explained how to launch Amazon ECS cluster including cloud formation, VPC and subnet creation,  ELB and ECS security group creation, auto scaling group, launch configuration, elastic load balancer creation with the help of sample app by creating a task definition, scheduling tasks and configuring a cluster through Amazon ECS First Run Wizard. In this blog, I will Continue Reading

AWS | Introduction to Amazon EC2 Container service

Reading Time: 3 minutes What is Amazon ECS (EC2 Container Service)? Amazon EC2 Container Service (ECS) is a highly scalable, high performance container management service that supports containers and allows you to easily run and manage Docker enabled applications across a cluster of Amazon EC2 instances. And now you guys are thinking, but what does that mean? It means that the same Docker containers that you currently use will Continue Reading

Introduction to AWS IAM

Reading Time: 3 minutes AWS IAM roles is a web service which gives you secured “Control Access” to AWS services for your users. IAM policies specify which services/actions are allowed or denied. You attach policies to group, users, roles which are then subject to permission that you define. In other words, IAM policies define what your user can do to your AWS services. IAM is Identity and Access management Continue Reading

Building Analytics Engine Using Akka, Kafka & ElasticSearch

Reading Time: 5 minutes In this blog , I will share my experience on building scalable, distributed and fault-tolerant  Analytics engine using Scala, Akka, Play, Kafka and ElasticSearch. I would like to take you through the journey of  building an analytics engine which was primarily used for text analysis. The inputs were structured, unstructured and semi-structured data and we were doing a lot of data crunching using it. The Analytics Continue Reading