Author Archives: Kunal Kapoor

Application compatibility for different Spark versions


Recently spark version 2.1 was released and there is a significant difference between the 2 versions. Spark 1.6 has DataFrame and SparkContext while 2.1 has Dataset and SparkSession. Now the question arises how to write code so that both the versions of … Continue reading

Posted in apache spark, Java, Scala, Spark | Tagged , , , , | 3 Comments

Deep Dive Into Elasticsearch


In this presentation, we are going to discuss how Elasticsearch handles the various operations like insert, update, delete. We would also cover what is an inverted index and how segment merging works. You can also watch the video on youtube:

Posted in Scala | Leave a comment

Autocomplete using Elasticsearch


You would have seen in a movie data store like IMDB, Whenever a user enters ‘g’, the search bar suggests him that you might be looking for gone girl or all the movies that have ‘g’ in them. This is … Continue reading

Posted in Elasticsearch, Scala | Tagged , , , , , , , , | 3 Comments

Introduction to ElasticSearch in Scala


Elasticsearch is a real-time distributed search and analytics engine built on top of Apache Lucene. It is used for full-text search, structured search and analytics. Lucene is just a library and to leverage its power you need to use Java. … Continue reading

Posted in Elasticsearch, Scala | Tagged , , | 4 Comments