Spark Internals

Knolx: How Spark does it internally?

January 14, 2019Apache Spark, Big Data and Fast Data, Studio-ScalaDAG in Spark, RDDs in Spark, Spark Internals, Spark with Scala, What is Spark?

Reading Time: < 1 minute Knoldus has organized a 30 min session on Oct 12 at 3:30 PM. The topic was How Spark does it internally? Many people have joined and enjoyed the session. I am going to share the slides and the video here. Please let me know if you have any question related to linked slides. How Spark Does It Internally? from Knoldus Inc. Here’s the video of the Continue Reading

Spark Unconstructed | Deep dive into DAG

August 23, 2018Apache Spark, cluster, Java, Studio-Scala, Tech BlogsDirected Acyclic Graph, Spark Internals, What is DAG?

Reading Time: 4 minutes Apache Spark is all the rage these days. People who work with Big Data, Spark is a household name for them. We have been using it for quite some time now. So we already know that Spark is lightning-fast cluster computing technology, it is faster than Hadoop MapReduce. If you ask any of these Spark techies, how Spark is fast, they would give you a Continue Reading