Author Archives: Shubhra Sharma

Avoiding Boilerplate with PureConfig


The PureConfig library of Scala avoids boilerplate while loading configurations, which has always been an error-prone and monotonous procedure. The common way that we follow is deserializing each field of the configurations, which is again a cumbersome task. The more … Continue reading

Posted in Scala | Tagged , , , | Leave a comment

Resolving the Failure Issue of NameNode


In the previous blog “Smattering of HDFS“, we learnt that “The NameNode is a Single Point of Failure for the HDFS Cluster”. Each cluster had a single NameNode and if that machine became unavailable, the whole cluster would become unavailable … Continue reading

Posted in big data, HDFS, Scala | Tagged , , , , , , , | 1 Comment

Smattering of HDFS


INTRODUCTION TO HDFS :- Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers.It has many similarities with existing distributed file systems. However, the differences from other distributed file … Continue reading

Posted in HDFS | Tagged , , , , , | 2 Comments