Reading Time: 4 minutes What is Apache Airflow? Airflow is a platform to programmatically author, schedule & monitor workflows or data pipelines. These functions achieved with Directed Acyclic Graphs (DAG) of the tasks. It is an open-source and still in the incubator stage. It was initialized in 2014 under the umbrella of Airbnb since then it got an excellent reputation with approximately 800 contributors on GitHub and 13000 stars. Continue Reading
Reading Time: 3 minutes HAWK is a Rust based Image Recognition project, which implements a two-factor authentication by using the RFID card for user identification and Image for user validation. In this project, we have used AWS services and the whole AWS infrastructure required by this project is automated using Terraform (a tool for building, changing, and versioning infrastructure safely and efficiently).
Reading Time: 4 minutes In my previous blog, we discussed the setup of Grafana-Graphite for JMX monitoring. Now we will create a first Grafana dashboard where we will create Grafana queries to visualize JMX metrics stored in Graphite. As we know, Grafana UI runs on http://localhost:3000/ by default so let’s open the URL in the browser with the default username and password which is admin: admin After login either Continue Reading
Reading Time: 4 minutes Introduction In this blog post we shall be discussing on AWS:AssumeRole approach for obtaining temporary security credentials using STS(Security Token Service) end to end setup. Temporary Security Credentials (consisting of access key id, secret access key and a security token) enables you to have an access to AWS Environment for a specified duration. It solves use cases like cross account access and single sign-on to Continue Reading
Reading Time: 2 minutes Introduction AssumeRole and Federation are two widely used approaches provided by AWS to facilitate authorization of cloud resources via Identity Management System (IDMS). In this post, we will describe the Federation and AssumeRole approaches and their integration. We will also see how they are different, and finally, conclude which one serves better. FEDERATED USERS Federated Users(external identities) are users you manage outside of AWS for Continue Reading
Reading Time: 3 minutes Amazon CloudFront is a web service that speeds up the distribution of your static and dynamic content such as HTML, CSS, js, and images to your users. CloudFront delivers the content through a worldwide network of data centers called edge locations, which means when a user requests the content that you are serving with CloudFront, the user is routed to the edge location that provides Continue Reading
Reading Time: 3 minutes Amazon S3 has a simple web services interface that you can use to store and retrieve any amount of data, at any time, from anywhere on the web. This blog describes : how you can create buckets on S3, getting credential keys, where should you keep your credential keys. CREATION OF BUCKET First of all, you need to sign up in aws S3 after that Continue Reading
Reading Time: 3 minutes Welcome everyone to the file upload on Amazon S3 using the Rust. Amazon S3 [Amazon Simple Storage Service] provides virtually limitless storage on the internet. For the bucket creations and security credentials please refer to my last blog. This blog explains following requests using Rust: sending a request to aws S3 bucket, list of objects in the bucket, putting an object in the bucket, deleting Continue Reading
Reading Time: 2 minutes This blog walks through the packaging of simple python project. Lets add the necessary files and structure to create the package, then build the package and upload it to python package index ( PyPI ). Let suppose your project (sample_pkg) is created in the root directory. Mandatory Basic Directory Structure of your sample project should be: /sample_pkg /sample_pkg __init__.py project util and source code files Continue Reading
Reading Time: 4 minutes DynamoDB is a part of Amazon Web Services. It is a NoSQL database, which supports key-value and document data structures. In this blog, we will be discussing Core components of DynamoDb. Features of DynamoDb: It is a fully managed NoSQL database. It can store & retrieve any amount of data, and can serve any amount of traffic. To maintain fast performance, it distributes data Continue Reading
Reading Time: 6 minutes In a Knolx session organized by Knoldus, we discussed the idea of following Saga Patterns. For that to be more accessible, I’d like to share the session with the help of this blog. Service-oriented architecture has given us enough advantages to be a predominant architecture in our Industry, but it can’t be all sunshine and rainbows. There are use cases where monoliths are not only Continue Reading
Reading Time: 3 minutes Hi readers, this is my second blog on AWS lambda, I covered the basics in my previous blogs. Now we will focus on the implementation part. Before starting, please keep a check on these things: Prerequisite Setup your AWS account, click here Understanding what AWS Lambda is? click here All set let’s start.
Reading Time: 5 minutes In the previous blog, we have learned how to create a domain on Amazon ES and also how to create an index using Curl on the cluster. Now, let’s just look how we can control access to Amazon ES Domain. One of the key benefits of using Amazon ES is that you can utilize AWS Identity and Access Management (IAM) to control access to your Continue Reading