AWS Services

Stream your data using Amazon Kinesis Firehose

Reading Time: 4 minutes We live in a world driven by data and every second we are processing a large amount of data, using it, analyzing it, and transforming it. Data is very essential for businesses these days. Therefore need for handling the Dynamically generating data is important. As the number, variety, and velocity of data sources grow, new architectures and technologies are needed. Technologies like Amazon Kinesis are Continue Reading

How to generate AWS Signature with Postman

Reading Time: 4 minutes Hello folks, I hope you are having a productive day in this pandemic of COVID-19. Let’s move on to our next blog in the series of API automation. Most of us are doing automation using the tool Postman. So while performing automation with postman we have to integrate many other tools and APIs with Postman. Similarly to use the AWS APIs we need to create Continue Reading

AWS Serverless Services: Lambda

Reading Time: 3 minutes Hi folks, next in the series of our Serverless Service is AWS Lambda. But before that if you haven’t checked my previous blog on the serverless series, take a look at it here https://blog.knoldus.com/aws-serverless-services-athena/ What is AWS Lambda AWS Lambda is a compute service that lets you run code without provisioning or managing servers. What this basically means is that you can write the code Continue Reading

AWS Serverless Services: Athena

Reading Time: 2 minutes Hi folks, in my this series about the AWS Serverless Services, I will be covering few the services provided by AWS and which can be used as an part of your Server less Architecture. This is going to be a developers perspective, so I would be writing everything about service but security and connectivity. At the end of this series we will try to put Continue Reading

Automate deployment using AWS CodeDeploy

Reading Time: 6 minutes In the CodeDeploy blog series, we are going to write two blogs the first blog covers the CodeDeploy theory-based and In the second blog, we will cover the full end-to-end automation practical of the application deployment using CodeDeploy and Jenkins. Let’s start aws CodeDeploy is basically a deployment service through which we can easily automate your deployment.

Amazon EMR

Reading Time: 3 minutes Businesses worldwide are discovering the power of new big data processing and analytics frameworks like Apache Hadoop and Apache Spark, but they are also discovering some of the challenges of operating these technologies in on-premises data lake environments. They may also have concerns about the future of their current distribution vendor. Common problems of on-premises big data environments include a lack of agility, excessive costs, Continue Reading

Setting up the IAM permission for AWS Lambda

Reading Time: 3 minutes About AWS AWS Lambda is a compute service that lets you run code without managing servers. AWS Lambda executes your code only when needed and scales automatically. You pay only for the compute time you consume – there is no charge when your code is not running. Why IAM? Before we call Lambda function we need to get correct permission setup to access the function. Continue Reading

Getting started with Amazon SNS

Reading Time: 2 minutes Introduction The Simple Notification Service (SNS) is used as a publish and subscribe messaging service. But what does it mean? SNS is centered around topics and you can think of a topic as a group for collecting messages. Users or endpoints can then subscribe to this topic and messages or events are then published to that topic. When a message is published, all subscribers to Continue Reading

Getting started with Amazon SQS

Reading Time: 4 minutes With the continuing growth of microservices and a cloud best practice of designing decoupled systems, it’s important that developers have the ability to utilize a service or system that handles the delivery of messages between components and this is where SQS comes in. Amazon SQS (Simple Queue Service) is a fully managed service offered by AWS, that works seamlessly with server-less systems, microservices or any Continue Reading

Defining your workflow: Why Not Airflow?

Reading Time: 4 minutes What is Apache Airflow? Airflow is a platform to programmatically author, schedule & monitor workflows or data pipelines. These functions achieved with Directed Acyclic Graphs (DAG) of the tasks. It is an open-source and still in the incubator stage. It was initialized in 2014 under the umbrella of Airbnb since then it got an excellent reputation with approximately 800 contributors on GitHub and 13000 stars. Continue Reading

HAWK-Rust Series: Automate Infrastructure using Terraform

Reading Time: 3 minutes HAWK is a Rust based Image Recognition project, which implements a two-factor authentication by using the RFID card for user identification and Image for user validation. In this project, we have used AWS services and the whole AWS infrastructure required by this project is automated using Terraform (a tool for building, changing, and versioning infrastructure safely and efficiently).