Knoldus Blogs

Google Cloud Platform: Migrating Data to New Schemas on Big Query Using Dataflow

February 1, 2023February 14, 2023AI, GCP, ML, AI and Data EngineeringApache Beam, BigQuery, Data, Data Migration, Dataflow, Google Cloud, Pipelines, python

Reading Time: 6 minutes Migrating data on Google Cloud BigQuery may seem like a straightforward task, until you run into having to match old data to tables with different schemas and data types. There are many approaches you can take to moving data, perhaps using SQL commands to transform the data to be compatible with the new schema. However, SQL has limitations as a programming language, being a query-centric Continue Reading

Developing programmer Development Website design and coding technologies working

Schema migration with Liquibase and Micronaut

December 25, 2022December 29, 2022Database, Java, Micronaut, MicroservicesData Migration, Database, java, Micronaut, postgreSQL, schema

Reading Time: 3 minutes In today’s world of microservices, each microservice has its own set of information stored in some kind of data store. This data store can be either a database or some other system that can retain the data for a period of time. We moved to microservices because we didn’t want one set of functionality not to be impacted by the changes in other functionality. After Continue Reading

black and gray laptop computer turned on doing computer codes

Liquibase : Getting started with Version Based Database Migration

May 18, 2022May 18, 2022Studio-DevOpsData Migration, Database, Devops, liquibase, Migration

Reading Time: 6 minutes Hi everyone, today in this blog we are going to talk about version-based database migration With Liquibase. Introduction Creating the database for your application seems to be easy. As long as you don’t need to support multiple versions or work in a huge team. You just generate an SQL script from your database model. Or in the worst case, export the required statements from your Continue Reading

Neo4j With Scala : Migrate Data From Other Database to Neo4j

September 12, 2016September 12, 2016Database, Studio-ScalaData Migration, Neo4j, Neo4j Apoc Procedure, Neo4J with Scala, scala, Starting with Neo4J

Reading Time: 6 minutes Hello Folks; Lets continue the Neo4j with Scala. We have earlier discuss about the use of Neo4j with Scala and Neo4j APOC with Scala. In this blog we are going to discuss about how we can migrate data from the other database like MYSQL, PostgreSQL, Oracle and Cassandra. But before starting the journey, To those who have caught the train late 😉 , this is Continue Reading