Knoldus Blogs

Google Cloud Platform: Migrating Data to New Schemas on Big Query Using Dataflow

February 1, 2023February 14, 2023AI, GCP, ML, AI and Data EngineeringApache Beam, BigQuery, Data, Data Migration, Dataflow, Google Cloud, Pipelines, python

Reading Time: 6 minutes Migrating data on Google Cloud BigQuery may seem like a straightforward task, until you run into having to match old data to tables with different schemas and data types. There are many approaches you can take to moving data, perhaps using SQL commands to transform the data to be compatible with the new schema. However, SQL has limitations as a programming language, being a query-centric Continue Reading

Basics of Machine Learning and it’s Algorithms -You Need to Know

May 10, 2021May 10, 2021Studio-ScalaAlgorithms, Data, datasets, Machine Learning, reinforcement learning, supervised learning, Unsupervised Learning

Reading Time: 6 minutes Machine Learning and it’s Algorithms Hi folks! Are you intrigued about Machine Learning and its Algorithms? If yes, Welcome. You have come to the right place. In this blog you will learn about machine learning and it’s algorithms. By the end of the blog, you will have the basic understanding of this field Machine Learning The term is self-explanatory enough that there is going to Continue Reading

Why Databricks Delta called as Unified Data Management?

September 17, 2019October 15, 2019Big Data and Fast Data, Studio-ScalaBig Data Analytics, Data, Deltas

Reading Time: 3 minutes Let’s discuss how Databricks Delta solves these problems by providing reliable, high-performance, and simple data pipeline solutions.

Data Governance using Apache ATLAS

May 30, 2019May 30, 2019Apache Kafka, Architecture, Big Data and Fast Data, Database, Studio-Scala, Tech Blogsapache, atlas, Data, Governance, kafka, metadata, REST

Reading Time: 3 minutes In the present scenario, enterprises have data on the network, on the cloud, and on the endpoint. Thus enabling governance on data is a critical step to understand the sources governing data, last update on the data, classification of data, the relationship and linkage between data and data sources. Apache Atlas helps in providing the ability to analyze the metadata and then take actions and Continue Reading

Getting started with TensorFlow: A Brief Introduction

November 19, 2017July 19, 2018ML, AI and Data EngineeringAI, Analysis, Analytics, Artificial intelligence, Computation, cpu, Data, Data Flow Graphs, deep learning, Getting, Getting Started, google, GPU, learn, learning, Machine Learning, Numerical Computation, Started, Tensor, TensorFlow, Tensors, Tutorial

Reading Time: 3 minutes TensorFlow is an open source software library, provided by Google, mainly for deep learning, machine learning and numerical computation using data flow graphs. Looking at their website, the first definition they have written for TensorFlow goes something like this – TensorFlow™ is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges Continue Reading