Author: Rahul Kumar

Functional Coverage with Jacoco Agent in Maven project(uses Apache Spark)

Reading Time: 2 minutes Hello Friends , In last day i was doing some configuration work to extract functional coverage report using JACOCO Agent.jar. At first i would mention that i was working on maven project and it was running over the Apache Spark 1.5 . I followed steps mentioned below to get functional coverage  (You can comment below if you have any better way to do this 🙂 Continue Reading

Streaming with Apache Spark Custom Receiver

Reading Time: 2 minutes Hello inqisitor. In previous blog we have seen about the predefined Stream receiver of Spark. In this blog we are going to discuss about Custom receiver of spark so that we can source the data from any . So if we want to use Custom Receiver than we should know first we are not going to use SparkSession as entry point , if there are Continue Reading

Apache Spark 2.0 with Hive

Reading Time: 1 minute Hello geeks , we have discussed about how to start programming with spark in scala. In this blog we will discuss about how we can use hive with spark 2.0. When you start to work with hive , at first we need HiveContext (inherits SqlContext)  , core-site.xml , hdfs-site.xml and hive-site.xml for spark. In case if you dont configure hive-site.xml then the context automatically creates metastore_db in the Continue Reading

Knolx – A Step to Programming with Apache Spark

Reading Time: 3 minutes Hello associate! Hope you are doing well . Today I am going to share some of my programming experience with Apache Spark. So if you are getting started with Apache Spark then this blog may helpfull for you. Prerequisite to start with Apache Spark – MVN / SBT Scala To start with Apache Spark at first you need to either download pre-built Apache Spark  or, Continue Reading

Knoldus Pune Careers - Hiring Freshers

Get a head start on your career at Knoldus. Join us!