Knoldus Blogs

Spark Structured Streaming (Part 3) – Stateful Streaming

August 14, 2020August 21, 2020Analytics, Apache Spark, Big Data and Fast Data, ML, AI and Data Engineering, Spark, Streaming, Streaming Solutions, Studio-Scala, Tech Blogsstateful streaming, stateful streaming scala, Structured Streaming

Reading Time: 4 minutes Welcome back folks to this blog series of Spark Structured Streaming. This blog is the continuation of the earlier blog “Internals of Structured Streaming“. And this blog pertains to Stateful Streaming in Spark Structured Streaming. So let’s get started. Let’s start from the very basic understanding of what is Stateful Stream Processing. But to understand that, let’s first understand what Stateless Stream Processing is. In Continue Reading

How to Integrate JMeter into Jenkins

September 8, 2020September 8, 2020github, Jenkins, LoadTesting, Studio-Scala, Test Automation Studio, Testinggit, Jenkins CI/CD, JMeter, Performance Plugin

Reading Time: 4 minutes Hey Guys, I hope you are doing well in this pandemic of COVID-19. Let’s move to the next blog in a series of performance testing. In my earlier blogs, we came to know about creating scripts in JMeter and working with them. Now in this blog, we will learn how to Integrate JMeter into Jenkins Basically, we will execute the JMeter script through/CD tool. Now Continue Reading

Finding the nexus between intelligent technologies and business

May 18, 2020May 18, 2020Business Insights, Studio-ScalaArtificial intelligence, Business Intelligence, Machine Learning

Reading Time: 2 minutes Artificial Intelligence & Machine Learning has indeed taken over our lives at every step of the way. For example: Starting out for your holiday tomorrow? Your smartphone will automatically send you weather reports and suggest itineraries. Ever seen your email software suggest smart replies while you’re drafting emails or replying to one? That’s also AI at work.

Understanding DevSecOps for Kubernetes

October 1, 2020October 12, 2020Kubernetes, Security, Studio-DevOpsDevSecOps, kubernets, Security

Reading Time: 4 minutes Increase in Security Demands for Cloud Native Ecosystems In today’s world, the need for securing our cloud native clusters has increased more than ever. Also this year, cloud-native security is again top trending, according to a report published by Gartner. DevSecOps is a simple answer to multiple questions. In the recently concluded KubeCon 2020, we saw that a lot of organisations are taking huge strides Continue Reading

Concourse CI CD pipeline

September 25, 2020September 25, 2020Studio-DevOpscicd, concourse, continuous deployment, continuous integration, Devops, kubernetes, maven, pipeline, springboot

Reading Time: 4 minutes In this blog, we are going to set up a typical CI/CD pipeline using concourse to make the development process more agile and deployment more visible.

Deploying DAML Smart Contracts on Hyperledger Sawtooth

June 10, 2020July 17, 2020Blockchain, DAMLBlockchain, daml, hyperledger, sawtooth

Reading Time: 5 minutes In our last blog, Deploying DAML based Smart Contracts on project:DABL, we deployed our daml application on project:DABL, a blockchain platform by digital asset. We also discussed how DAML provides support on multiple blockchain platforms like hyperledger sawtooth, fabric, Corda etc. In this blog we will take a step further in our DAML journey and deploy our application on another blockchain platform which is Hyperledger Continue Reading

MachineX: Anticipate Customer behavior for Retailing

February 18, 2020February 20, 2020AI, Artificial intelligence, ML, AI and Data EngineeringArtificial intelligence, behaviour driven development, Machine Learning, retail analytics

Reading Time: 4 minutes In this blog, we are going to see the power of Customer behavior Anticipation and how it can derive the success of the retail sector. Nowadays, Machine learning is playing an important in the success of different sectors. we can talk about Healthcare, Finance, Manufacturing, Agriculture, now even in Education. Retail is one of the sectors, which is getting huge benefits from machine learning and Continue Reading

Databricks Deployment via Jenkins

June 3, 2020June 3, 2020Spark, Studio-DevOpscicd, databricks, deployment, Devops, Jenkins

Reading Time: 3 minutes In this blog, We will learn how do we create the Databricks Deployment pipelines to deploy databricks components(Notebooks, Libraries, Config files and packages) via a Jenkins.

Jmeter-Extract data using Post Processor Part- II

August 21, 2020August 21, 2020LoadTesting, Test Automation Studio, TestingJMeter, Performance Testing, Postprocessor, regular expression

Reading Time: 4 minutes Hello everyone ! I hope you are doing well in this pandemic of COVID-19. In the previous blogs, we saw how we can extract the data from Jmeter using post-processor- JSON Extractor. Here in this blog, we will see other post-processors like Regular Expression. Many of us feel that creating regular expressions is difficult for non-technical people. So most of us avoid using regular expressions Continue Reading

HTTP Client in Java 11

June 22, 2020June 22, 2020JavaHttpClient, java

Reading Time: 3 minutes Introduction to httpClient and how to use it in real time.

AI : Nature of Environments

May 21, 2020May 21, 2020Artificial intelligence, Studio-Scala, Tech BlogsAgents

Reading Time: 2 minutes In the previous posts, we looked at the Rational Agent and the operating environment. In this post we would try to study the nature of the environment. The environment is the Task Environment (problem) for which the Rational Agent is the solution. Any task environment is characterised on the basis of PEAS. Performance – What is the performance characteristic which would either make the agent Continue Reading

Using Spark as a Database

November 23, 2020November 23, 2020Apache Spark, Big Data and Fast Data, Database, SQL, Studio-Scala

Reading Time: 4 minutes You must have heard that Apache Spark is a powerful distributed data processing engine. But do you know that Spark (with the help of Hive) can also act as a database? So, in this blog, we will learn how Apache Spark can be leveraged as a database by creating tables in it and querying upon them. Introduction Since Spark is a database in itself, we Continue Reading

The Role of Securities Market Place in trading

June 7, 2020June 7, 2020FinTeach, Studio-Scala, tradingDebt, Equity, Fintech, Knoldus Singapore, Securites, Securities Marketplace, singapore, singaporetech, Trading

Reading Time: 3 minutes Hello folks, in the previous blog, I had discussed about some essential trading concepts and terminologies. In this blog, I am going to describe you about the structure and components of the Securities market place. In any street market, the goods that sold are manufactured outside of the marketplace and the characters involved are those who visit the marketplace to buy goods. And those who Continue Reading