Reading Time: 2 minutes We all know that Apache spark is a Big data processing engine that works on the model of in-memory computation. When we are dealing with extensive data even if we are able to reduce the use of even 1 MB of memory per minute it will result in thousands of dollars per month. Hence it becomes essential to learn the spark best practices and optimization Continue Reading
Reading Time: 3 minutes Today in this new era, customers demand superlative products. Hence to accomplish this continuous development, DevOps and continuous testing came into the picture. Organizations are moving to automation testing to accomplish their goal of efficiency. To achieve the best result with automation testing, one must follow the complete cycle of automation testing. Let’s check how to start automation testing When to think of automation testing? Continue Reading
Reading Time: 3 minutes As we all know that we can make static variable, method or class. We know what it can do. If we make a variable static then that variable scope is present for the entire run of the program. Its memory is shared by all the object of the class in which it is declared. We make the method so that it can not be inherited. Continue Reading
Reading Time: 4 minutes If you are reading this blog there may be two reasons. First, you are the programmer and second, you want to be a better programmer. So here we go, Even bad code can function, But if the code isn’t clean, it can bring a development organization to its knees. Every year, countless hours and significant resources are lost because of the poorly written code. But Continue Reading
Reading Time: 8 minutes “Any fool can write code that a computer can understand. Good programmers write code that humans can understand.” – Martin Fowler “I can code.” I always say to myself. But do others think the same? Is my code good enough for people to understand? Do other people think “Damn I wish I could write such code.?” – that’s the main question I always had in Continue Reading
Reading Time: 4 minutes “Good software system begins with clean code” and by “clean code”, I mean it is code that is easy to understand and easy to change. This is the point where there is a need to know about SOLID Principles which helps us in writing the clean code as the code is like humour. “When you have to explain it, it’s bad.” The SOLID PRINCIPLES tell Continue Reading
Reading Time: 6 minutes In our earlier blog, we explored a bit about Microservices. But let’s take a step back and look into how microservices can be effectively designed. Yes, you guessed it right. We will be talking about the Domain Driven Design or what we call the DDD approach. But before jumping into the concepts of Domain Driven Design, let’s understand 2 basic terminologies : Domain: A domain is the sphere Continue Reading
Reading Time: 3 minutes Scala Trait and Mixin – Points to Remember Trait can be viewed not only as interfaces in other languages, but also as classes with only parameterless constructor. Whenever there is some code in trait, the trait is called mixin. trait Alarm { def trigger(): String } In scala trait, If we create simple class and pass parameter in constructor, without any val or var, it Continue Reading
Reading Time: 3 minutes Data loading, in Spark SQL, means loading data in memory/cache of Spark worker nodes. For which we use to write following code: val connectionProperties = new Properties() connectionProperties.put(“user”, “username”) connectionProperties.put(“password”, “password”) val jdbcDF = spark.read .jdbc(“jdbc:postgresql:dbserver”, “schema.table”, connectionProperties) In here we are using jdbc function of DataFrameReader API of Spark SQL to load the data from table into Spark Executor’s memory, no matter how many rows are Continue Reading
Reading Time: 5 minutes If you have been in the software industry for some time you would have heard things like. Yes we do Scrum but …we do not have timeboxed sprints. Yes, we write automated user acceptance tests but … as a part of the Sprint planning we decide whether we would write automated test for a story or do ad-hoc manual testing. Oh, and our test coverage Continue Reading
Reading Time: 2 minutes In a conversation with one of the lead architects of a large publishing company, we were discussing around the coding standards and suddenly the term EOP brought the discussion to a standstill. Ok, just for a few seconds. Once I explained it, it was like “Ah, is that it ?” If you are doing Scala, you can be assured that you are good with it Continue Reading
Reading Time: < 1 minute The term Extreme Programming (XP) was coined by Kent Beck, in late 1990s. The purpose behind inventing XP was to find a way to deliver high quality software, developed by small teams, and to keep up with the changing requirements of customer. Although, XP is more than a decade old now, it is still being practiced by a lot of developers around the world. The following slide deck and Continue Reading
Reading Time: 3 minutes Recently there has been a lot of interest in the cloud. There have been some major developments that have ignited the interest of many enterprises. It would not be late before enterprises start looking around and find that their competitors have already taken the first step towards the cloud. Before you get to that situation and start panicking, here is a list of best practices Continue Reading
