DevOps

Shims: An Overview

Reading Time: 3 minutes With the prevalence of 64-bit operating systems, many applications have become 64-bit compliant. But, there is a large group of existing native applications that still run in 32-bit compatibility mode on 64-bit operating systems. While integrating 64-bit applications with 32-bit applications, we face numerous compatibility challenges relating to the size of the data type, address, pointers, binary format, and runtime dependencies. The 64-bit applications cannot Continue Reading

Amazon EMR

Reading Time: 3 minutes Businesses worldwide are discovering the power of new big data processing and analytics frameworks like Apache Hadoop and Apache Spark, but they are also discovering some of the challenges of operating these technologies in on-premises data lake environments. They may also have concerns about the future of their current distribution vendor. Common problems of on-premises big data environments include a lack of agility, excessive costs, Continue Reading

Setting up the IAM permission for AWS Lambda

Reading Time: 3 minutes About AWS AWS Lambda is a compute service that lets you run code without managing servers. AWS Lambda executes your code only when needed and scales automatically. You pay only for the compute time you consume – there is no charge when your code is not running. Why IAM? Before we call Lambda function we need to get correct permission setup to access the function. Continue Reading

Introduction with handlers in Ansible

Reading Time: 2 minutes Hi readers, In this blog, we will be discussing the use case of Ansible handlers also we will be looking at how multiple handlers work get notifr Ansible. What is Handlers in Ansible? Handlers are just like normal tasks in an Ansible playbook but they run only when if the Task contains a “notify” directive. It also indicates that it changed something. Let take a Continue Reading

Python Scripts: An Introduction

Reading Time: 7 minutes Introduction Python is a great flexible programming language that can be used in many situations. In this tutorial, we will focus primarily on it’s ability to enhance the Unix/Linux shell environment. Typically in Unix we will create “bash” shell scripts, but we can also create shell scripts using python, and it’s really simple! We can even name our shell scripts with the .sh extension and Continue Reading

Ansible Roles: Directory Structure

Reading Time: 4 minutes Hi readers, in this blog we will be discussing about Ansible roles and the directory structure used in Ansible. Above all, we will be looking at what different directories in a role do and how they can be created. What are Ansible Roles? According to the official Ansible documentation ‘roles are ways of automatically loading certain vars_files, tasks, and handlers based on a known file Continue Reading

Handling Errors in Ansible

Reading Time: 3 minutes Hello readers, in this blog we will be looking at how to handle errors in Ansible Playbooks. There are multiple ways for doing the same and we will be looking at them and how to use it in our Playbook. By default, Ansible will check the return codes of commands and modules and it fails fast. This means that we will be forced to deal Continue Reading

ReplicationController and ReplicaSet in Kubernetes

Reading Time: 5 minutes Hello readers, Welcome to another blog on kubernetes. My previous blog was on pods. Today, I’ll be covering ReplicationController and ReplicaSet, which are considered as wrappers on a pod. So before going further, I would like you to go through my previous blog and get a basic idea on pods. Replication Controller As discussed above, replication controller, also termed as rc in short, is a Continue Reading

Users and Groups in Linux

Reading Time: 4 minutes Hello readers, welcome to my blog on users and groups in Linux. As we know that Linux is a multi-user operating system, we’ll see how to add and configure the users and groups in Linux. What does multi-user mean? An operating system is considered as multi-user when it allows multiple users to access a computer. Also, Keeping security in mind, it does not allow a Continue Reading

Apache Spark: Read Data from S3 Bucket

Reading Time: < 1 minute Amazon S3 Accessing S3 Bucket through Spark Edit spark-default.conf file You need to add below 3 lines consists of your S3 access key, secret key & file system