Optimizing Indexing speed in Elasticsearch with Spark
Reading Time: 4 minutes optimize indexing
bulk indexing elasticsearch
Introducing Infura: Connecting DApps with Ethereum Network without setting up Ethereum Nodes
Reading Time: 3 minutes If you’ve been working on Decentralized applications based on Ethereum, you might have come across setting up the Local Ethereum Node or your own private Ethereum node to test your application. In my case, Setting up Ethereum nodes and connecting dApps with it has been a problem for me for the following reasons: If I use any of the Ethereum clients (geth or parity) Continue Reading
Ethereum Networks – Part II: Setting up Private Testnet on the local machine
Reading Time: 2 minutes In the previous blog: Understanding the different kinds of Ethereum Networks, we talked about what are the different kinds of Ethereum Networks and how to choose a specific network when starting the development with Ethereum. In this blog, we will provide you a cheat sheet of Linux commands which you can refer to quickly set up the private network on your machine without going through Continue Reading
Understanding Different kinds of Ethereum Networks
Reading Time: 3 minutes After gulping a lot about the “disrupting” things related to Blockchain technology, I was very intrigued to quickly set up a development environment with whatever is free and useful on the Internet for developing a kick-ass DApp (I am Joking, Just trying “Hello, World!” 😉 I came to learn that “Ethereum” is the most matured protocol around blockchain. Before I proceed further with tools available Continue Reading
Setting up cucumber and sbt in IntelliJ
Reading Time: 3 minutes If you want to look into a starter project where cucumber feature file can be run right from IntelliJ IDEA with sbt as a build tool, this blog is a perfect match. I will put the below ingredients and complete recipe on how to write a feature file and plug it in with your implementation steps in IntelliJ IDEA. Ingredients: build.sbt First three lines may Continue Reading
Ansible Playbooks vs Roles: Part I – The Playbook
Reading Time: 3 minutes I assume you know with basics of Ansible and familiar with the terminologies of Ansible. If not, you can visit our previous starter blog. In this blog, we will take a look on how we can quickly start writing Ansible playbooks with a simple example and in the later or next part of the blog, we will look at how they can be reused to Continue Reading
Blue Green Deployments: Reducing the downtime of apps
Reading Time: 2 minutes Ever heard of “application outage”? As part of agile practice we release our work frequently and often when a newer version of an application released to production, we get application outages due to issues like unexpected traffic, introduced a bug into the newer version or other unknown PITA issues. This cause some (actually a lot!) of chaos in terms of time efforts to recover from failures and Continue Reading
Error handling in Scala: What, where and how?
Reading Time: 5 minutes error handling, monadic, functional erorr handling
AMPS: Empowering real time message driven applications.
Reading Time: 3 minutes Greetings!! In this blog, we will talk about AMPS, a pub-sub engine which delivers messages in real time with a subject of interest. AMPS is mainly used by Financial Institutions as enterprise message bus. We will also demonstrate how we can use AMPS with to publish and subscribe messages with an example. So, let’s start with introducing AMPS. What is AMPS? Advanced Message Processing System Continue Reading
Introduction to Structured Streaming
Reading Time: < 1 minute Hello!! Knoldus had organized half an hour session on Structured Streaming briefing about the API changes, how it is different from the early Stream Computation paradigm (DStreams) and example API demonstration. Hope you will enjoy. Below are the slides and Video from the session. Slide: Video:
Sharing RDD’s states across Spark applications with Apache Ignite
Reading Time: 4 minutes Apache Ignite offers an abstraction over native Spark RDDs such that the state of RDDs can be shared across spark jobs, workers and applications which is not possible with native Spark RDDS. In this blog, we will walk through the steps on how to share RDDs between two spark Application. Preparing Ingredients To test the Apache Ignite with Apache Spark application we need at least one master Continue Reading
Controlling RDD Partitions in Apache Spark
Reading Time: 2 minutes In this blog, we will discuss What is RDD partitioning, why Partitioning is important and how to create and use spark Partitioners to minimize the shuffle operations across the nodes in a distributed Spark application. What is Partitioning? Partitioning is a transformation operation which is available on all key value pair RDDs in Apache Spark. It is required when we try to group values on the basis Continue Reading
Build your personalized movie recommender with Scala and Spark
Reading Time: 3 minutes In this blog I will explain what is a recommendation engine in general, and How to build a personalized recommendation model using Scala and Spark Collaborative filtering algorithm. What is a Recommendation Engine? I assume you’ve shopped online for books or visited movie review sites to pick top rated movies to watch. You must have been seen top rated movie lists which have been voted Continue Reading