Nebula Spark Connector Reader: Principles and Practices

4 years ago dzone.com

Summary: This is a summary of an article originally published by the source. Read the full original article here →

Nebula Spark Connector is a custom Spark connector, enabling Spark to read data from and write data to Nebula Graph. Therefore, Nebula Spark Connector is composed of a Reader and Writer.

With it, Spark can read data from Nebula into DataFrame and then execute the operations such as map and reduce.

In Nebula Spark Connector, Nebula Graph is defined as an external data source of Spark SQL and sparkSession.read is used to read data from Nebula Graph.

The process is as follows: Nebula Spark Connector Reader provides you with an interface to programmatically read data from Nebula Graph.

DevOps Articles