Scala

Using Protocol Buffers in Scala

What is Protocol Buffers? Protocol buffers are a flexible, efficient, automated mechanism for serializing structured data – think XML, but smaller, faster, and simpler. You define how you want your data to be structured once, then you can use special generated source code to easily write and read your structured data to and from a variety of data streams and using a variety of languages. Continue Reading

A Beginner’s Guide to Deploying a Lagom Microservice on Kubernetes

Both Lagom and Kubernetes are gaining popularity quite fast. Lagom is an open source framework for building reactive microservice systems in Java/Scala. And, Kubernetes (or K8s in short) is an open-source system for automating deployment, scaling, and management of containerized applications. Together they make an excellent stack for developing Reactive microservices of production grade. We have already seen a lot of blogs on Lagom on this Continue Reading

Scheduling Jobs with Akka Scheduler

Hey folks, in this blog I am going to explain how can you schedule jobs that you want to repeat over a certain period of time with the help of Akka Scheduler. Suppose you have a use-case in which you want some cleaning background process to run a cleanup-repository method to delete records after a fixed interval of time, then look nowhere else because Akka scheduler Continue Reading

Introduction to Dotty

Dotty is the new scala compiler that 2.13 Scala release will be using. It is based on the DOT in its internal structure. The calculus used in Dotty is same as that of DOT. Dotty is a faster compiler than the scala compiler that Scala 2 uses. In this blog, I’ll be discussing the advantages of dotty, its architecture and the features that have been Continue Reading

Functional Programming: Lambda Calculus

We have already explored the introduction to FP in my previous blog. Once you get into FP, you’ll quickly start hearing the terms lambda and lambda calculus. Lambda: Lambda is basically just a symbol represented as λ that Alonzo Church chose when he first defined the concept of a function. In modern functional programming, lambda means “anonymous function“. Calculus: Calculus is means a formal system in mathematical logic for expressing Continue Reading

kafka with spark

Tuning a Spark Application

Having trouble optimizing your Spark application? If yes, then this blog will surely guide you on how you can optimize it and what parameters should be tuned so that our spark application gives the best performance. Spark applications can cause a bottleneck due to resources such as CPU, memory, network etc. We need to tune our memory usage, data structures tuning, how RDDs need to Continue Reading

HDFS: A Conceptual View

There has been a significant boom in distributed computing over the past few years. Various components communicate with each other over network inspite of being deployed on different physical machines. A distributed file system (DFS) is a file system with data stored on a server. The data is accessed and processed as if it was stored on the local client machine. The DFS makes it convenient to share information Continue Reading

Alpakka – Connecting Kafka and ElasticSearch to Akka streams

In our previous blog, we had a look at what Akka streams are and how they are different from the other streaming mechanisms we have. In this blog, we will be taking a little step forward into the world of Akka Streams. In order to work with Akka streams, we need a mechanism to connect Akka Streams to the existing system components. That is where Alpakka Continue Reading

Introduction to Akka Streams-Part 2

In the previous blog Introduction to Akka Streams-Part 1, I have given a brief introduction about Akka Streams and its components. In this blog, I’ll be discussing the features of Akka Streams. Akka Streams is an implementation of Reactive Streams. The features of Akka Streams: Reusable pieces, Time based processing, Backpressure are discussed below in detail. Reusable pieces In many streams API, we can not Continue Reading

AMPS (Advanced Message Processing System)

Hi readers, in this blog, I will talk about what are AMPS, how it works, and then finally will talk about how to run it with a working example. So let’s get started…!! What are AMPS(Advanced Message Processing System)? AMPS from 60East Technologies is a fast messaging engine that supports both publish-subscribe messaging and queuing. It is not just a simple messaging engine it is Continue Reading

Pagination in Angular

What if, you have to scroll down infinitely through a large chunk of data. Well, I don’t think you have plenty of time to explore that ocean of information. So here comes Pagination which divides the content into separate pages. In angular, we have a library called ngx-pagination which is supported in Angular 2.3.0+. This can be added to your application by installing the library. npm Continue Reading

RUST – Ownership

One of the very distinctive features that make Rust stand out among the other languages is the way it does memory management. Memory management in C happens by either declaring a variable or by allocating a chunk of space at runtime. The same then can be freed using explicit function calls. So basically the control resides with the developer which may result in error-prone code. Continue Reading

Testing Node.Js Application with Gatling

In one of our project we needed to test a node.js application, so in this blog, I’ll be discussing node.js application using Gatlingjs. Gatlingjs Gatlingjs is an npm library to run gatling from a node.js project by placing the simulation files in your project repository. Prerequisites In order to setup Gatling, your system should have JDK8 and Scala installed so following are the links to Continue Reading

%d bloggers like this: