Tuning spark on yarn
Reading Time: 2 minutes In this blog we will learn how to tuning yarn with spark in both mode yarn-client and yarn-cluster,the only requirement to get started is that you must have a hadoop based yarn-spark cluster with you. In case you want to create a cluster you can follow this blog here. 1. yarn-client mode: In client mode, the driver runs in the client process, and the application master is only used Continue Reading