Source: thenewstack.io
‘Reverse ETL’ Can Help Companies Operationalize Data LakesCategory: Business, Database, Security, Data, Privacy, Infrastructure, Architecture, encryption, artificial-intelligence
Enterprises building data lakes and warehouses have been turning to third-party vendors to bring in data. These data pipeline vendors extract data from the source systems and load the data into the warehouse.
When people want to understand the validity of a metric that was transformed in flight, there is no way to audit it and identify the progress of the data,” he said.
The reconciliation requirements also mean that the reverse ETL vendor has to have some way of looking at the data as it flows through the pipeline in order to decide what to do with it.
There’s not that many companies that have already implemented the modern data stack of the future where everything is in Snowflake and they’re ready to sync over.
When people want to understand the validity of a metric that was transformed in flight, there is no way to audit it and identify the progress of the data,” he said.
The reconciliation requirements also mean that the reverse ETL vendor has to have some way of looking at the data as it flows through the pipeline in order to decide what to do with it.
There’s not that many companies that have already implemented the modern data stack of the future where everything is in Snowflake and they’re ready to sync over.
Related Articles
Community Partners
DevOps Careers