Is Apache Flink the future of Real-time Streaming?

Anmol SarnaDecember 28, 2018Apache Flink, Flink, Java, Scala, Streaming, Streaming SolutionsFlink Streaming, scala, Spark Streaming, Streaming

In our last blog, we had a discussion about the latest version of Spark i.e 2.4 and the new features that it has come up with. While trying to come up with various approaches to improve our performance, we got the chance to explore one of the major contenders in the race, Apache Flink. Apache Flink is an open source platform which is a streaming Continue Reading

Apache Spark 2.4: Adding a little more Spark to your code

Anmol SarnaDecember 16, 2018Apache Spark, Java, Scala, Spark, StreamingApache Spark, avro, higher order function, scala, spark 2.4

Continuing with the objectives to make Spark faster, easier, and smarter, Apache Spark recently released its fifth release in the 2.x version line i.e Spark 2.4. We were lucky enough to experiment with it so soon in one of our projects. Today we will try to highlight the major changes in this version that we explored as well as experienced in our project. In our Continue Reading

Scala: Facade Design Pattern

Nancy JainDecember 13, 2018Functional Programming, ScalaDesign Pattern, Facade Design Pattern, programming, scala, Structural design pattern, Structural Pattern

Hi Everyone, In our previous blogs, we have discussed several Structural design patterns i.e., Decorator design pattern, Adapter design pattern and Proxy design pattern. In this blog, we will be discussing Facade Design pattern and will try to implement it in Scala. Problem Statement: We recently had a tour to Udaipur from our office and to organize it, we inquired a travel agency and asked Continue Reading

Using Protocol Buffers in Scala

Prabhat KashyapDecember 13, 2018Scalabuffer, google, protocol, scala, Serialization

What is Protocol Buffers? Protocol buffers are a flexible, efficient, automated mechanism for serializing structured data – think XML, but smaller, faster, and simpler. You define how you want your data to be structured once, then you can use special generated source code to easily write and read your structured data to and from a variety of data streams and using a variety of languages. Continue Reading

Scheduling Jobs with Akka Scheduler

Manjot KaurDecember 3, 2018Akka, ScalaAkka, scala, scheduler

Hey folks, in this blog I am going to explain how can you schedule jobs that you want to repeat over a certain period of time with the help of Akka Scheduler. Suppose you have a use-case in which you want some cleaning background process to run a cleanup-repository method to delete records after a fixed interval of time, then look nowhere else because Akka scheduler Continue Reading

Akka Streams: Is it a Solution to Your Streaming Problems?

Anmol SarnaOctober 16, 2018October 16, 2018Akka, akka-streams, Java, Scala, Streaming, Streaming SolutionsAkka actor, akka-streaming, broadcasting, Data Flow Graphs, scala, Streams

A few days earlier, in our project, we were using Spark streaming and initially, it worked like a charm. But as we were very close to completion of our use case, the unexpected occurred. Spark does have a lot of interesting features, but we had some more custom needs such as running a ton of varying jobs with different actors/flows. Also, we needed something which Continue Reading

Trying to use form field and file upload directive together in Akka-Http?

Miral GandhiOctober 1, 2018October 1, 2018Akka, akka-http, akka-streams, Scalaakka-http, scala

If you are reading this then probably you have encountered the issue that comes while accessing fields with uploading a file, and if not then let me first tell you what’s the situation that I’m talking about here, Let’s see the code where we try to use fileUpload directive and formFields together

MachineX: Association Rule Learning with KSAI

Akshansh JainSeptember 10, 2018September 10, 2018ML, AI and Data Engineering, ScalaAI, association rule learning, KSAI, Machine Learning, MachineX, scala, Scalable

In many of my previous blogs, I have posted about Association Rule Learning, what it’s about and how it is performed. In this blog, we are going to use Association Rule Learning to actually see it in action, and for this purpose, we are going to use KSAI, a machine learning library purely written in Scala. So, let’s begin. Adding KSAI to your project You Continue Reading

Scala : Proxy Design Pattern

Nancy JainAugust 31, 2018August 31, 2018Architecture, Functional Programming, Scala, Tech BlogsDesign, Design Pattern, learning, programming, Proxy design pattern, scala, Structural design pattern

Hi Everyone! In our previous blogs, we have discussed Decorator design pattern and Adapter design pattern. Now, its time to discuss another Structural design pattern i.e. the Proxy design pattern. We will implement the same EUGDPR problem using the Proxy design pattern, which we implemented using the Adapter design pattern in our previous blog. Problem Statement: Earlier, in many applications, all the user-specific details like Continue Reading

Adapter design pattern with Scala

Nancy JainAugust 22, 2018August 24, 2018Scala, Tech BlogsAdapterDesignPattern, Design, DesignPattern, Getting Started, Introduction, programming, scala, ScalaDesignPattern, StructuralPattern

Hi Readers! In our last blog, we have discussed the Decorator design pattern with Scala. In this blog, we will explore the Adapter design pattern. We will also implement this pattern in Scala. Earlier, in many applications, all the user-specific details like username, IP addresses, phone number, etc were logged directly without scrambling it. But after new data protection law i.e. EUGDPR, it is now Continue Reading

Functional Programming: A Paradigm

Ayush HoodaAugust 14, 2018Functional Programming, ScalaAdvantages and disadvantages of Functional Programming?, Functional Paradigm, Functional Programming In Scala, scala, scalafp, What is Functional Programming?

It’s surprisingly hard to find a consistent definition of functional programming. But I think you can define FP with just two statements: 1. FP is about writing software applications using only pure functions. 2. When writing FP code you only use immutable values. Hence, Functional programming is a way of writing software applications using only pure functions and immutable values. Now, let us understand the Continue Reading

Back2Basics: Understanding Partially Applied Functions

Mahesh ChandJuly 30, 2018July 30, 2018Scalaback2basics, currying, Functional Programming, partial applied functions, scala, scalafp

In this blog, we are going to talk about Partially applied functions and its use case. Before starting, first, we will emphasize that though Partial functions and Partially applied functions sound similar they are different from each other. To understand Partial Functions refer. What is function application? Applying a function is called calling a function. When we pass all arguments of the function, we can Continue Reading

CuriosityX: RDDs – The backbone of Apache Spark

Anmol SarnaJuly 30, 2018July 31, 2018Apache Spark, HDFS, Java, Scala, SparkApache Spark, Hadoop, java, partitioning in apache spark, RDD, scala, Spark

In our last blog, we tried to understand about using the spark streaming to transform and transport data between Kafka topics. After reading that many of the readers asked us to give a brief description of RDDs in Spark which we used. So, this blog is totally dedicated to the RDDs in Spark. So let’s start with the very basic question that comes to our mind Continue Reading

scala