AWS

Sentry

Self-Hosted Deployment of Sentry over AWS

Reading Time: 2 minutes Hello Readers. This will be a blog series on Self-hosted Sentry deployment over AWS. In the 1st blog of this series, I’ll be deploying a self-hosted Sentry server. Before starting up with deployment, let’s first understand what Sentry is and what does it provide. What is Sentry? Sentry is a service that helps you monitor and fix crashes in real-time. It helps in tracking errors Continue Reading

AWS Transit Gateways – Learning made simple

Reading Time: 7 minutes A transit gateway is a network transit hub. It allows us to interconnect our virtual private clouds (VPCs) and the on-premises networks. The AWS transit gateway saves us the effort of creating multiple VPC peering connections between all the existing VPCs. And establishing VPN tunnels between the on-premise network and each individual VPC, in order to establish connectivity. Imagine a scenario with four VPCs, As Continue Reading

Stream your data using Kinesis data stream

Reading Time: 3 minutes We live in a world driven by data and every second we are processing a large amount of data, using it, analysing it, and transforming it. Data is very essential for businesses these days. Therefore the need for handling the Dynamically generating data is important. As the number, variety, and velocity of data sources grow, new architectures and technologies are needed. This is where the need Continue Reading

Handling failed SQS Events using AWS Dead Letter Queue(DLQ)

Reading Time: 3 minutes Amazon SQS is an amazing simple queuing service which offers us a secure, durable hosted queue which lets us integrate and decouple distributed software component. One of the exciting features that SQS provides us with is the support of dead letter queue. Whenever we are using SQS for queuing messages for our services there may be times that our message gets corrupted or for some Continue Reading

Using CodeShip with CodeDeploy

Reading Time: 5 minutes What is CodeShip ? CodeShip is a hosted continuous delivery service that focuses on speed, simplicity and reliability. It is a fast and secure hosted CI service that scales as per user’s needs. CodeShip was founded in 2011, and pretty soon it became one amongst the Saas Continuous Integration and Continuous Delivery leader in the market. CodeShip is now backed by a larger company with Continue Reading

Loading JSON data into Snowflake

Reading Time: 4 minutes Have you ever faced any use case or scenario where you’ve to load JSON data into the Snowflake? We better know JSON data is one of the common data format to store and exchange information between systems. JSON is a relatively concise format. If we are implementing a database solution, it is very common that we will come across a system that provides data in Continue Reading

Amazon EMR

Reading Time: 3 minutes Businesses worldwide are discovering the power of new big data processing and analytics frameworks like Apache Hadoop and Apache Spark, but they are also discovering some of the challenges of operating these technologies in on-premises data lake environments. They may also have concerns about the future of their current distribution vendor. Common problems of on-premises big data environments include a lack of agility, excessive costs, Continue Reading

Data Lake – Build it in Phases

Reading Time: 3 minutes Data Lake – How to build a data lake and what are the phases involved in the same.

Apache Spark: Read Data from S3 Bucket

Reading Time: < 1 minute Amazon S3 Accessing S3 Bucket through Spark Edit spark-default.conf file You need to add below 3 lines consists of your S3 access key, secret key & file system spark.hadoop.fs.s3a.access.key “s3keys” spark.hadoop.fs.s3a.secret.key “yourkey” spark.hadoop.fs.s3a.impl org.apache.hadoop.fs.s3a.S3AFileSystem

Getting started with Amazon SNS

Reading Time: 2 minutes Introduction The Simple Notification Service (SNS) is used as a publish and subscribe messaging service. But what does it mean? SNS is centered around topics and you can think of a topic as a group for collecting messages. Users or endpoints can then subscribe to this topic and messages or events are then published to that topic. When a message is published, all subscribers to Continue Reading