Time Travel

KSnow: Time Travel and Fail-safe in Snowflake

July 24, 2020August 2, 2020Analytics, AWS, Big Data and Fast Data, Cloud, Database, ML, AI and Data Engineering, SQL, Tech Blogssnowflake, Time Travel

Reading Time: 5 minutes This blog pertains to Time Travel and Fail-safe in Snowflake, and I will explain you all the things you need to know about these features with practical example. So let’s get started. Introduction to Time Travel Snowflake allows accessing historical data of a point in the past that may have been modified or deleted at the current time. Using time travel functionality a number of Continue Reading

Time Travel: Data versioning in Delta Lake

February 2, 2020February 2, 2020Analytics, Apache Spark, Big Data and Fast Data, Java, Spark, Studio-ScalaApache Spark, Big Data, Big Data Analytics, BigData, data lake, Data Management, data science, delta lake, Spark, Time Travel

Reading Time: 3 minutes In today’s Big Data world, we process large amounts of data continuously and store the resulting data into data lake. This keeps changing the state of the data lake. But, sometimes we would like to access a historical version of our data. This requires versioning of data. Such kinds of data management simplifies our data pipeline by making it easy for professionals or organizations to Continue Reading