A New Tool for the Open Source LLM Developer Stack: Aviary

2 years ago thenewstack.io

Summary: This is a summary of an article originally published by The New Stack. Read the full original article here →

The company behind Ray, an https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/ that helps power ChatGPT, has just released a new tool to help developers work with large language models (LLMs). Like Ray, Aviary is being released as an open source project.

The goal of Aviary is to enable developers to identify the best open source platform to fine-tune and scale an LLM application.

There needed to be a way for developers to easily deploy, manage and maintain their chosen open source model.

Aviary currently supports nine different open source LLMs, ranging from small models with 2 billion parameters to larger ones with 30 billion parameters.

DevOps Articles