Architecture

Apache Spark Cluster Internals: How spark jobs will be computed by the spark cluster

Reading Time: 2 minutes In this blog we are explain how the spark cluster compute the jobs. Spark jobs are collection of stages and stages are collection of tasks. So before the deep dive first we see the spark cluster architecture. In the above cluster we can see the driver program it is a main program of our spark program, driver program is running on the master node of Continue Reading

Play 2.4.X : Microservice Architecture using Play and Scala

Reading Time: < 1 minute Playing-Microservices This blog describes a basic Microservice architecture design using Play 2.4.X and Scala. The big idea behind microservices is to architect large, complex and long-lived applications as a set of cohesive services that evolve over time. The term microservices strongly suggests that the services should be small. In short, the microservice architectural style is an approach to developing a single application as a suite Continue Reading

Conditional logging with Logback in Scala

Reading Time: < 1 minute Hello Folks In my project , i got a scenario where I wanted conditional logging. I was using Logback framework for the same. I wanted to set different logging level for staging and production. Either i could do manually changes in logback.xml for logging level for staging and production both. But this is not the good practice. Then I found the solution of implementing the Continue Reading

Scala in Business | Knoldus Newsletter – March 2015

Reading Time: 2 minutes Hello Folks We are back again with March 2015, Newsletter. Here is this Scala in Business | Knoldus Newsletter – March 2015 In this newsletter, you will get the business related news for Scala. How organisation are adopting Scala for their business, how Scala related technologies increasing the performance of application and how Scala is getting popular in the industry So, if you haven’t subscribed to Continue Reading

Remote profiling using SSH Port Forwarding (SSH Tunneling) on Linux

Reading Time: < 1 minute In this blog post I’ll lay out few steps that are needed for remote profiling using SSH Port Forwarding (SSH Tunneling) using Yourkit profiler.   Steps to be followed on remote machine: 1) Download Yourkit profiler from official Yourkit website. 2) Extract the downloaded file anywhere. 3) What we need to do now is find the file named libyjpagent.so in the extracted folder corresponding to Continue Reading

Role of an Agile Architect

Reading Time: 8 minutes This post is a reproduction of my article which has been published on Agile Journal by the name The Shiny New Agile Architect. You can download the pdf here. Recently there has been a lot of talk on whether we need an Architect on agile teams or not. There have been never-ending discussions on various forums both inside organizations and out in the public questioning Continue Reading