Spark to Vertica

Using Vertica with Spark-Kafka: Write using Structured Streaming

July 3, 2019July 16, 2019Apache Kafka, Apache Spark, Big Data and Fast Data, Functional Programming, HDFS, Spark, Streaming, Streaming Solutions, Studio-ScalaApache Kafka, Apache Spark, DataFrame, Kafka Spark, Spark, Spark SQL, spark sql kafka, Spark Structured Streaming, Spark to Vertica, Streaming, Structured Streaming, Vertica, Write to vertica

Reading Time: 3 minutes In two previous blogs, we explored about Vertica and how it can be connected to Apache Spark. The first blog in this mini series was about reading data from Vertica using Spark and saving that data into Kafka. The next blog explained the reverse flow i.e. reading data from Kafka and writing data to Vertica but in a batch mode. i.e reading data from Kafka Continue Reading