Reading Time: 3 minutes As we all know, Spark contains a whole variety of inbuilt functions through which you can do any sort of transformation in your data frame and achieve your desired output, but sometimes you may find that you don’t require them. Then What? In that case, you can define your own function, known as UDFs (User Defined Functions) which makes it possible to write your own Continue Reading
Reading Time: 9 minutes Are you a Scala developer looking to migrate your existing Scala 2.13 projects to the latest version of the language? If so, you’ll be happy to know that Scala 3 is now available and comes with a range of new features and improvements. With its streamlined syntax, improved performance, and better compatibility with Java 8 and above, Scala 3 offers a host of benefits for Continue Reading
Reading Time: 2 minutes Reactive streams support infinite data and handle backpressure. What if we want to perform a batch operation on top of the reactive stream. Can we batch over the infinite stream? In this blog, we will see how we can batch with Project Reactor reactive stream without breaking the streaming boundary and with handling the backpressure. The Problem Space In my project, one of the Microservice’s Continue Reading
Reading Time: 4 minutes Introduction Reactive Programming is a paradigm that helps developers write event-driven applications by using observable streams of data. It’s often used in modern applications, especially on mobile devices and the web. In this article, we’ll explain what is and why we need it. We’ll also look at some of its benefits. And limitations so you can decide if it’s right for your project or not! Continue Reading
Reading Time: 5 minutes What are Functional effects? Functional effects refer to the changes or modifications in the state of a program or system as a result of executing a specific function. These effects can include updating variables, creating or destroying objects, modifying data structures, or triggering external events such as sending messages or making HTTP requests. They are an important aspect of functional programming, as they allow developers Continue Reading
Reading Time: 2 minutes I am glad and happy to announce our new version and a new portal for Accelerators is up and live. Knoldus Accelerators – https://accelerator.prod.go1percent.com/ We have divided our accelerator into 3 parts – Learning Accelerators These are your one-step solution providing curated templates in more than 22 technologies and languages. It’s a repository of templates to accelerate all your development requirements. Kickstart your development with Continue Reading
Reading Time: 2 minutes It all began in 2012 when the first commit for Scala 3 was made and it was decided to base Scala 3 on DOT. What is DOT? Before we go further into the story, let’s get to know about DOT. DOT, an abbreviation for Dependent Object Types, is a new type-theoretic calculus which models path-dependent types, abstract type members, and it creates a mixture of Continue Reading
Reading Time: 4 minutes Data Lake A Data Lake is a place to store enterprise data in one common place. This data can be further accessed by data wranglers with analytical needs. However, a data lake is different from a normal database. As a data lake can store current and historical data for different systems in its raw form for analysis. And, a database stores current updated data for Continue Reading
Reading Time: 4 minutes Domain Driven Design Crafting a software from interpretation of business terminologies aka. domain in turn leads to better processes for coding/development. This reflects true software craftsmanship. Abstracting software helps to create domain models. These models can bridge the gap between complex business requirements and developer’s code. The term DDD was coined by Eric Evans in his book, also an Interesting read for DDD: With DDD the structure, design Continue Reading
Reading Time: 3 minutes In this blog post, we will discuss ZIO fibers and how we can use them. We will also get a quick overview of operations on ZIO fibers. Concurrency in ZIO ZIO is a highly concurrent framework powered by fibers, which are lightweight virtual threads that enable huge scalability when compared to threads, reinforced with resource-safe cancellation, which supports several features in ZIO. This robust concurrency Continue Reading
Reading Time: 2 minutes We all know that Apache spark is a Big data processing engine that works on the model of in-memory computation. When we are dealing with extensive data even if we are able to reduce the use of even 1 MB of memory per minute it will result in thousands of dollars per month. Hence it becomes essential to learn the spark best practices and optimization Continue Reading
Reading Time: 2 minutes In this blog, we are going to know about LRU Cache and how to implement it in Scala Language. What is LRU Cache? Least Recently Used Cache is an algorithm used for cache eviction. As the name is suggesting Least Recently Used item will be evicted here. Basically, it removes the least recently used page/frame when the capacity or size of the cache is full Continue Reading
Reading Time: 4 minutes Introduction In this blog, we’ll explore some fundamental notions of reactive programming in an effort to better comprehend what it is. What is Reactive Programming? Reactive is a style of programming that encourages an event-driven, asynchronous approach to data processing. “Asynchronous data streams and change propagation are dealt with in reactive programming.“ Now let’s take a moment and understand what the above statement actually means Continue Reading
