Reading Time: 3 minutes As we all know, Spark contains a whole variety of inbuilt functions through which you can do any sort of transformation in your data frame and achieve your desired output, but sometimes you may find that you don’t require them. Then What? In that case, you can define your own function, known as UDFs (User Defined Functions) which makes it possible to write your own Continue Reading
Reading Time: 4 minutes Before diving into gRPC descriptors and it’s implementation in kalix let’s get a brief understanding of gRPC so, What is gRPC? gRPC is an open-source Remote Procedure Call (RPC) framework developed by Google. It’s modern, fast, efficient, and built on top of HTTP/2, low latency supports streaming, is language-independent, and makes it super easy to plug in authentication, load balancing, logging, and monitoring. Now the Continue Reading
Reading Time: 3 minutes This is the second part of the blog series on Spark‘s structured APIs Dataframe & Datasets. In the first part we covered Dataframe and I recommend you go read that blog first if you are new to spark. In this blog we’ll cover the Spark Datasets API, so let’s get started. The Datasets API Datasets are also the combination of two characteristics: typed and untyped Continue Reading
Reading Time: 4 minutes This is a two-part blogs in which first we’ll be covering Dataframe API and in the second part Datasets. Spark 2.x introduced the concept of structuring the spark by introducing two concepts: – to express some computation by using common patterns found in data analysis, such as filtering, selecting, counting, aggregating, and grouping. And the second one of order and structure your data in a Continue Reading
Reading Time: 2 minutes Databricks Command Line Interface is one of the handiest CLI which can come to the rescue whenever you are working with Databricks notebook. It is an easy-to-use interface for the Databricks platform which is built upon the Rest API 2.0. To Get Started With Databricks CLI Installing the DBCLI For installing the CLI you must have these prerequisite in your local machine: Python2(version 2.79 & Continue Reading
Reading Time: 2 minutes We all know that Apache Spark is a super-fast cluster computing technology that is designed for fast computation on large volumes of big data. Spark’s ability to do this is dependent on its design philosophy which centers around four key characteristics: Speed Ease of use Modularity Extensibility So let us dive into this design philosophy and see how Apache Spark operates Sparks Components & Architecture Continue Reading
Reading Time: 3 minutes Hey, coders in this blog we are going to talk about Singleton Pattern, and believe me, Singleton Pattern is one of the easiest patterns among all the design patterns in terms of its class diagram. Singleton Pattern has an interesting mechanism in the way it is implemented. So before implementing the singleton pattern in our code first let’s dive into its definition which states that Continue Reading
Reading Time: 3 minutes This blog is in the continuation of its first part where we discussed the basic part of object-oriented concepts. In this blog, we will cover four pillars in the object-oriented world of programming in Scala. OOPS Four Pillars Four pillars are basically the software design principles that help you to write clean Object-Oriented Code and these are: Abstraction Encapsulation Inheritance Polymorphism Let’s take a closer Continue Reading
Reading Time: 3 minutes Object-Oriented Programming in short OOP every programmer in their programming career always faces this concept. We are going to cover the concept of OOPs in two parts. This is the first part where we are gonna talk about basic understanding of OOP and the concept of classes & objects. What is OOP? According to the wiki, OOP is a programming paradigm based on the concept Continue Reading
Reading Time: 4 minutes In Scala, we all know that throwing an exception is a side effect and there is no such word as “side effect” in functional programming. If exceptions aren’t used in functional code, what is used instead? Now the idea is that in order to implement error handling in a functional style of code we can represent failures and exceptions with ordinary values. And also, we Continue Reading
Reading Time: 3 minutes Hi community, in this blog we are gonna talk about the Traits and how Scala Traits can help you while performing multiple inheritances. What are Traits? Scala does not allow the concept of multiple inheritances for more than one class, so to do multiple inheritances Scala uses Traits A trait is a fundamental unit of code reuse in Scala. A trait holds the definitions of Continue Reading
Reading Time: 3 minutes Hi, community in this blog we are gonna talk about one very important feature of Functional style programming in Scala so make your IntelliJ ready and let’s learn about Higher-Order Functions. Before going into Higher Order Function first let’s take a brief understanding of Functions in Scala. Functions in Scala As we all know, a function is a group of statements that performs a particular Continue Reading
Reading Time: 2 minutes Hi, community, in this blog, we will be covering what is pattern matching, when should we use it, and at the end, we’ll compare it with if-else. What is Pattern Matching? Pattern Matching is one of the most powerful tools in Scala. It’s similar to a switch statement in java but with loads of functionalities in comparison to a switch statement. Definition Pattern Matching is Continue Reading
