Author Archives: Mahesh Chand Kandpal

About Mahesh Chand Kandpal

Explorer + Technology Enthusiast + Foodie + Movie Buff

Working with XML in Scala

In this blog, we will talk about how we can work with XML using Scala. Scala treats XML as the first-class citizen. So, instead of embedding XML documents into strings. , you can place them inline in your code like … Continue reading

Posted in Functional Programming, Scala | Tagged , , | 1 Comment

How to throttle messages using Akka Fsm ?

A few days ago, I was having an issue that the rate of incoming message requests to the process was too high.  All requests were thus being processed in future. By default, every message request was getting processed in parallel. … Continue reading

Posted in Scala | 2 Comments

Exploring the Real Power of Functional Programming

We have been programming with object-oriented technology for quite a while. But now we are moving away from it. Functional Programming is getting lot of attention nowadays. Even every mainstream language is now supporting functional style i.e Java, C++, C# … Continue reading

Posted in Functional Programming, Java, Scala | Tagged , , , , | 5 Comments

Are you using Scala Collection efficiently?

In this blog, We will be going to explore how we can use scala collections efficiently . Though, we are taking care of immutability but still something more can be done to make your code more readable and faster. List … Continue reading

Posted in Functional Programming, Scala, scaladays | Tagged , , , | 3 Comments

Getting Started With Mesos

In our earlier blog Introduction to Mesos , we have talked about basic idea of Mesos. And How it works and its basic terminology. Till now we have discussed the theoretical concepts to get ourselves familiar with Mesos and now … Continue reading

Posted in Devops, Scala | Tagged , , , | 3 Comments

Introduction to Mesos

What is Mesos ? In layman’s term, Imagine a busy airport. Airplanes are constantly taking off and landing. There are multiple runways, and an airport dispatcher is assigning time-slots to airplanes to land or takeoff. So Mesos is the airport … Continue reading

Posted in Devops, Scala | Tagged , , , | 3 Comments

Having Issue How To Order Streamed Dataframe ?

A few days ago, i have to perform aggregation on streaming dataframe. And the moment, i apply groupBy for aggregation, data gets shuffled. Now the situation arises how to maintain order? Yes, i can use orderBy with streaming dataframe using … Continue reading

Posted in Apache Kafka, apache spark, big data, Scala, Spark, Streaming | Tagged , , , , , , , , , , | 2 Comments

Unit Testing Of Kafka

Apache Kafka is a distributed publish-subscribe messaging system and a robust queue that can handle a high volume of data and enables you to pass messages from one end-point to another. Generally, data is published to topic via Producer API … Continue reading

Posted in Apache Kafka, Scala, scalatest, Streaming, testing | Tagged , , , , | 4 Comments

Exploring Spark Structured Streaming

Hello Spark Enthusiasts, Streaming apps are growing more complex. And it is getting difficult to do with current distributed streaming engines. Why streaming is hard ? Streaming computations don’t run in isolation. Data arriving out of time order is a … Continue reading

Posted in apache spark, Scala, Streaming | Tagged , | 1 Comment

Spark Streaming vs Kafka Stream

The demand for stream processing is increasing a lot these days. The reason is that often processing big volumes of data is not enough. Data has to be processed fast, so that a firm can react to changing business conditions … Continue reading

Posted in Apache Kafka, apache spark, big data, Scala, Streaming | Tagged , | 2 Comments