Author: Jatin Demla

Introduction to Google Kubernetes

DevOps, Scala

Over the past two years, Containerization has provided a lot of flexibility to the developer in which most popular container technology is docker. Container provide the developer a virtual environment for isolated process or application on the host system. Before everything else lets take a look what used to happen in past. Earlier when the number of systems for running application were limited they were Continue Reading

protecting sensitive data in docker

A step-by-step guide for protecting sensitive data in docker

cluster, DevOps, Scala

Managing the password, access tokens and private keys are being tedious in the application. Any small mistakes accidentally expose all the secret information. Even storing such thing in docker images can be easily accessible one should just run the image in the interactive mode container and all your application code is available in containers. Docker provides secrets to protect all secret data. This blog explains Continue Reading

Knolx: Deploying Microservice on Docker

Scala

Knoldus has organized a 30 min session on 29th September 2017. The topic was “Deploying microservice on docker”. Many people have joined and enjoyed the session. I am going to share the slides and video here. Slides: Video: Please feel free to comment below for any query.  

kafka with spark

Integrating Kafka With Spark Structure Streaming

Apache Kafka, Apache Spark, Scala, Streaming, ,

Kafka is a messaging broker system which facilitates the passing of messages between producer and consumer whereas Spark Structure streaming consumes static and streaming data from various sources like kafka, flume, twitter or any other socket which can be processed and analysed using high level algorithm for machine learning and finally pushed the result out to external storage system. The main advantage of structured streaming Continue Reading

Avro Communication over TCP Sockets

Scala,

Storing/Transferring object is a requirement of most applications. What if there is a need for communication between machine having incompatible architecture. Java Serialization won’t work for that. Now, if you are thinking about Serialization Framework then you are right. So, let’s start with one of the Serialization framework Apache Avro. What is Avro? Apache Avro is a language-neutral data serialization system. It’s a schema-based system Continue Reading

%d bloggers like this: