Studio-Scala

Another Apache Flink tutorial, following Hortonworks’ Big Data series

Reading Time: 7 minutes Background A couple of weeks back, I was discussing with a friend of mine, on the topic of training materials on Apache Spark, available online. Of the couple of sites that I mentioned, the hadoop tutorial from Hortonworks, came up. This was primarily because I liked the way they organized the content: it was clearly meant for encouraging newcomers to try things hands-on, banishing the Continue Reading

Frontend to Backend: Everything is on Scala using Play, Scala.js and ScalaCSS

Reading Time: 2 minutes In my previous post, I tried to create a pure front-end application using Scala.js and ScalaCSS. So that we can build our front-end also in a typesafe way. But there was no server interaction. This time I have tried to make server interaction using play framework. Since this application is about Weather Information System, so I am  hitting a third party api to get weather Continue Reading

Broadcast variables in Spark, how and when to use them?

Reading Time: 2 minutes As documentation for Spark Broadcast variables states, they are immutable shared variable which are cached on each worker nodes on a Spark cluster.  In this blog, we will demonstrate a simple use case of broadcast variables. When to use Broadcast variable? Think of a problem as counting grammar elements for any random English paragraph, document or file. Suppose you have the Map of each word as specific Continue Reading

KnolX: Introduction to TitanDB

Reading Time: < 1 minute Knoldus organized a KnolX session on Wednesday, 27 April 2016.  In this KnolX session we discussed the key features and advantages offered by TitanDB for developing our applications. Since, TitanDB is an open source distributed graph database and has native integration with the TinkerPop graph stack, we started off with our focus being what are graph databases and how they are best suited for handling huge networks of heavily connected data. Further down the line we Continue Reading

Testing grammar using ANTLR4 TestRig (Grun)

Reading Time: 5 minutes “Always code as if the guy who ends up maintaining your code will be a violent psychopath who knows where you live.” –Martin Golding Quotes like above tell us the importance of testing the modules that we develop. Testing for different languages is done using various tools for example JUNIT for java, FunSuite for scala and TestRig (grun on command line) for grammar(.g4). In this Continue Reading

Integration Test Configuration in Play Framework

Reading Time: < 1 minute A few days ago I’ve come across a problem while writing integration testing of my play application. My need was like to run unit and Integration test separately, in a normal sbt project, it’s easy to configure it, but I couldn’t find proper documentation about how to do this in play application, because there are difference in the folder structure in both of them. The reason why I wanted Continue Reading

KnolX: Unit Testing of Spark Applications

Reading Time: < 1 minute Knoldus organized a KnolX session on Wednesday, 13 April 2016. In this KnolX session, we explored the different methods of writing unit tests for Spark applications. This session also talks about how unit testing of Spark applications is done, as well as tells about the best way to do it. This includes writing unit tests with and without Spark Testing Base package, which is a spark Continue Reading

Is Flink the shiny(err..) toy on the block?

Reading Time: 3 minutes If you are following the Big Data space especially from a Scala Space perspective then you would have noticed a troll of blogs, tweets and more blogs comparing the two. The two being Spark and Flink. That said, you would also find comparing these two with Samza and Storm. Incidentally all of them are top level Apache projects. For the purpose of this blog, let us stick Continue Reading

Ui made easy for Angular Js Developers

Reading Time: 2 minutes Angular Js developers sometimes feels bit confused when it comes to designing the UI, but there are some very useful and free directives are available in market that make the flow quite easy and interesting. Here in this blog we are going to give a small rest to Angular js developers by providing them a working introduction to these directives. For example how about having Continue Reading

UDF overloading in spark

Reading Time: 2 minutes UDF are User Defined Function which are register with hive context to use custom functions in spark SQL queries. For example if you want to prepend some string in any other string or column then you can create a following UDF def addSymbol(input:String, symbol:String)={ symbol+input } Now to register above function in hiveContext we need to register UDF as follows hiveContext.udf.register(“addSymbol”,(input:String,symbol:String)=>addSymbol(input,symbol)) Now you can use Continue Reading

How to write grammar for your own language with ANTLR .? (Part -I) : Setting up the Environment( Intellij with ANTLR)

Reading Time: 2 minutes Ever wondered about this question that actually how can we write our own language? How the grammer of clojure or scala can be written.? Here is the answer , we can write grammar for our own language using ANTLR. This is a powerful tool for generating Lexer, Parser and  Visitors for the grammar written by our self. So in this blog we will discuss how to configure Continue Reading

Expression Oriented Programming

Reading Time: 2 minutes In a conversation with one of the lead architects of a large publishing company, we were discussing around the coding standards and suddenly the term EOP brought the discussion to a standstill. Ok, just for a few seconds. Once I explained it, it was like “Ah, is that it ?” If you are doing Scala, you can be assured that you are good with it Continue Reading

Hybrid application development: Future of mobile application development

Reading Time: < 1 minute Knoldus organized a Meetup on Wednesday, 30 March 2016. In this Meetup, we gave a brief introduction of Hybrid application development with Ionic Framework and Apache Cordova. Ionic is chosen as best framework for hybrid mobile application development. A wide range of developers and big organizations are using it frequently. Checkout the slides and start developing apps, for any support please comment below.     Thanks Continue Reading