In this blog, we will see how to build a Simple Application in Spark & Scala using sbt.
Spark is a Map-Reduce like cluster computing framework, designed to make data analytics fast.
Before start building this application follow these instructions :-
1). Download Spark 0.9.1.
2). Unzip the binary package in any directory.
3). Go to the Spark directory.
4) Run ./sbt/sbt assembly
To successfully build Spark with sbt we need sbt 0.13.0 or later versions already installed in system.
After building Spark, we can start building the Application.
To build the Application follow these steps:
1). Run mkdir SimpleSparkProject.
2). Create a .sbt file in SimpleSparkProject/simple.sbt
3). Create a file SimpleSparkProject/src/main/scala/SimpleApp.scala
4). Then go to SimpleSparkProject directory.
5). Run sbt package
6). Run sbt run
To download a Demo Application click here.