Robert Nishihara is the co-founder and CEO of Anyscale, the company behind the open source platform, Ray — the https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/ being used by ChatGPT and other highly-scaled products, such as Uber. It was there that he, Stoica and Philipp Moritz (another graduate student) created Ray in 2016.
As for what data is being used in enterprises for AI workloads, Nishihara confirmed that it is mostly data owned by those companies.
“Uber runs all of their machine learning on Ray,” Nishihara told me.
I asked Nishihara to unpack how Ray helps organizations train and serve foundation models, in this new era of generative AI.