Tag Archives: programming

Let’s dive deep into Apache Ignite


Let’s first have some basic understanding of Apache Ignite and then we will look more into its life cycle with the help of a demo application. Apache Ignite is an in-memory computing platform that is durable strongly consistent and highly … Continue reading

Posted in Functional Programming, Java | Tagged , , , , , , , , , , | Leave a comment

Introduction to GraphQL – A Query Language for APIs


GraphQL is an API standard that provides a more efficient, powerful and flexible alternative to REST. It was created by Facebook in 2012 and was open-sourced in 2015 and is now maintained by a large community of companies and individuals from … Continue reading

Posted in Scala, Tutorial, Web, web application, Web Services, Web Standard | Tagged , , , , | 3 Comments

Having Issue How To Order Streamed Dataframe ?


A few days ago, i have to perform aggregation on streaming dataframe. And the moment, i apply groupBy for aggregation, data gets shuffled. Now the situation arises how to maintain order? Yes, i can use orderBy with streaming dataframe using … Continue reading

Posted in Apache Kafka, apache spark, big data, Scala, Spark, Streaming | Tagged , , , , , , , , , , | 1 Comment

Scala Best Practices


The central drive behind Scala is to make life easier and more productive for the developer — and that includes me. Scala does this with three principal techniques: It cuts down on boilerplate, so programmers can concentrate on the logic … Continue reading

Posted in Scala | Tagged , , | Leave a comment

Simple Java program to Append to a file in Hdfs


In this blog, I will present you with a java program to append to a file in HDFS. I will be using Maven as the build tool. Now to start with- First, we need to add maven dependencies in pom.xml. … Continue reading

Posted in big data, HDFS, Java | Tagged , , , | 1 Comment

R-The Statistical Programming Language


R is a powerful language used widely for data analysis and statistical computing. It was developed in the early 90s. It is one of the most popular languages used by statisticians, data analysts, researchers, and marketers to retrieve, clean, analyze, … Continue reading

Posted in Scala | Tagged , , , | 3 Comments

BigData Specifications – Part 1 : Configuring MySql Metastore in Apache Hive


Apache Hive is used as a data warehouse over Hadoop to provide users a way to load, analyze and query the data from various resources. Data is stored into databases or file systems like HDFS (Hadoop Distributed File System). Hive … Continue reading

Posted in Scala | Tagged , , , , , , , , , | Leave a comment

Effective Programming In Scala – Part 3 : Powering Up your code implicitly in Scala


Hi Folks, In this series we talk about the concepts that provide a better definition to the code written in scala. We provide the methods with some definitions that lead to perform a task in a better way. Lets have … Continue reading

Posted in Scala | Tagged , , , , , , , , , , , | 2 Comments

Intercepting Nutch Crawl Flow with a Scala Plugin


Apache Nutch, is an open source web search project. One of the interesting things that it can be used for is a crawler. The interesting thing about Nutch is that it provides several extension points through which we can plugin … Continue reading

Posted in Architecture, Scala | Tagged , , , , , , , | 2 Comments