Source: thenewstack.io
A New Tool for the Open Source LLM Developer Stack: Aviary
The company behind Ray, an https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/ that helps power ChatGPT, has just released a new tool to help developers work with large language models (LLMs). Like Ray, Aviary is being released as an open source project.
The goal of Aviary is to enable developers to identify the best open source platform to fine-tune and scale an LLM application.
There needed to be a way for developers to easily deploy, manage and maintain their chosen open source model.
Aviary currently supports nine different open source LLMs, ranging from small models with 2 billion parameters to larger ones with 30 billion parameters.
The goal of Aviary is to enable developers to identify the best open source platform to fine-tune and scale an LLM application.
There needed to be a way for developers to easily deploy, manage and maintain their chosen open source model.
Aviary currently supports nine different open source LLMs, ranging from small models with 2 billion parameters to larger ones with 30 billion parameters.
Related Articles
Community Partners
DevOps Careers