Scala

Mastering in Frontend : Getting Into Concepts – Part 1

Reading Time: 5 minutes All about AnguarJs, ReactJs, BackboneJs, JQuery and other libraries, from the intro to the actual concept.

Elasticsearch: How to paginate over selected data in elasticsearch with scala using Scroll API of elasticsearch.

Reading Time: 5 minutes Elasticsearch is  real-time,distributed,full-text search analytics engine.It is built on top of Apache Lucene™.You can read it more on their website. It provides a distributed, multitenant-capable full-text search engine with a RESTful web interface and schema-free JSON documents. Elasticsearch is developed in Java and is released as open source under the terms of the Apache License. Elasticsearch is the second most popular enterprise search engine. In Continue Reading

Apache Spark Cluster Internals: How spark jobs will be computed by the spark cluster

Reading Time: 2 minutes In this blog we are explain how the spark cluster compute the jobs. Spark jobs are collection of stages and stages are collection of tasks. So before the deep dive first we see the spark cluster architecture. In the above cluster we can see the driver program it is a main program of our spark program, driver program is running on the master node of Continue Reading

Couchbase: Quering data bucket with Partial id.

Reading Time: 2 minutes Introduction: In this article I am going to explain how to get documents from data bucket, if you only have partial Id, in other words using LIKE operation of Sql in couchbase by using Views of Couchbase. For Example: I have these four documents in my bucket, and I want to get all the documents having starting “abc”, then it must retrieve all the three Continue Reading

How the Interns at Knoldus Caused a Flutter at Scala Days 2015 !

Reading Time: 4 minutes Knoldus is a select Typesafe partner and has been engaged in delivering reactive, scalable products for the last 4.5 years. The company boasts of well rounded full stack developers who engage with the clients and take their reactive product dream to reality. A lot of case studies can be accessed here. An integral part of the Knoldus Internship Program (KIP) is to introduce great minds Continue Reading

KANBAN : AGILE Software Methodology

Reading Time: 3 minutes The era of traditional software development is no more viable, IT is looking for agility into its services. Business user changing demand, customer’s swift mind set and more on competition and sustainability in industry demand agile solution to be implemented. I see Agile as an opportunity to welcome new ideas, adopt changes around the world and improvise IT engineers life. There are multiple ways to Continue Reading

Data Science & Spark:- Data visualization for processing out the key factors using Zeppelin.

Reading Time: 3 minutes What is it a data scientist yearn for most? For me it’s Data Visualization. We know that under those massive layers of junk there is always something important hidden that can get noticed with the visualization. More importantly we need analytics for establishing relationship among all the values which could be quite hassling if done manually given how large and unstructured the dataset we may Continue Reading

Gnip using Spark Streaming :- An Apache Spark Utility to pull Tweets from Gnip in realtime

Reading Time: 2 minutes We all are familiar with Gnip, Inc. which provides data from dozens of social media websites via a single API. It is also known as the Grand Central Station for social media web. One of its popular API is PowerTrack which provides Tweets from Twitter in realtime along with the ability to filter Twitter’s full firehose, giving its customers only what they are interested in. This Continue Reading

Configuring SonarQube with Scoverage plug-in : The Complete Guide

Reading Time: 4 minutes This blog will guide you through the successful configuration of Scoverage plug-in with SonarQube for Scala source code statement coverage analysis. How Does it Work? The Scoverage plug-in for SonarQube reads the report generated by sbt scoverage plug-in and generate several reports like Statement Coverage % Analysis Lines covered by test Drilling down report to the file level The greatest advantage of SonarQube is the Continue Reading

Start/Deploy Apache Spark application programmatically using spark launcher

Reading Time: < 1 minute Sometimes we need to start our spark application from the another scala/java application. So we can use SparkLauncher. we have an example in which we make spark application and run it with another scala application. Let see our spark application code. import org.apache.spark.SparkConf import org.apache.spark.SparkContext object SparkApp extends App{ val conf=new SparkConf().setMaster(“local[*]”).setAppName(“spark-app”) val sc=new SparkContext(conf) val rdd=sc.parallelize(Array(2,3,2,1)) rdd.saveAsTextFile(“result”) sc.stop() } This is our simple spark Continue Reading

Stateful transformation on Dstream in apache spark with example of wordcount

Reading Time: 2 minutes Sometimes we have a use-case in which we need to maintain state of paired Dstream to use it in next Dstream . So we are taking a example of stateful wordcount in socketTextStreaming. Like in wordcount example if word “xyz” comes twice is in first Dstream or window, it reduce it and its value is 2 but its state will lost in the next Dstream Continue Reading

Apache spark + cassandra: Basic steps to install and configure cassandra and use it with apache spark with example

Reading Time: 3 minutes To build an application using apache spark and cassandra you can use the datastax spark-cassandra-connector to communicate with spark. Before we are going to communicate with spark using connector we should know how to configure cassandra. So following are prerequisite to run example smoothly. Following steps to install and configure cassandra If you are new to cassandra first we nee to install cassandra on our Continue Reading

Easiest Way to connect with Couchbase using Scala

Reading Time: 2 minutes In this blog, we have explained how easily we can connect with Couchbase, store and fetch data  using scala through an example. Tools and technologies used : SBT 0.13.8 Scala 2.11.6 Couchbase Server 4.0 Beta Eclipse JDK 1.7 Please follow below instructions to use this example:- 1) Install and configure Couchbase a) Download the couchbase server from here. b)  If you are using ubuntu, then Install the Continue Reading