4 years ago

Category: Data

In this article, we discuss how to use Spark listeners more effectively and provide a framework to better perform ETL with Spark. In the last quarter of 2019, I developed a meta-data driven, ingestion engine using Spark.