Methods

Spark: createDataFrame() vs toDF()

May 23, 2020May 9, 2022Apache Spark, Big Data and Fast Data, Spark, Studio-ScalaApache Spark, Big Data Analytics, DataFrame, implicit methods, Methods, Spark with Scala, Tuples

Reading Time: 2 minutes There are two different ways to create a Dataframe in Spark. First, using toDF() and second is using createDataFrame(). In this blog we will see how we can create Dataframe using these two methods and what’s the exact difference between them. toDF() toDF() method provides a very concise way to create a Dataframe. This method can be applied to a sequence of objects. To access Continue Reading

Scala Nuggets: Look Ma! My First DSL

April 13, 2011Java, Studio-ScalaConcise code, Methods, scala

Reading Time: 2 minutes DSL (Domain Specific Language) is a programming language or specification language dedicated to a particular problem domain, problem representation or a particular solution technique. So with a few Scala Nuggets on our way we are ready to write a DSL? Not quite but in this post we would touch upon a critical feature in Scala which makes writing DSL’s easy. Let us look at the Continue Reading