DevOps Articles

Curated articles, resources, tips and trends from the DevOps World.

Breakdown: The Kubernetes-Run AI Video Generation Pipeline for NIUS.TV

4 years ago thenewstack.io
Breakdown: The Kubernetes-Run AI Video Generation Pipeline for NIUS.TV

Summary: This is a summary of an article originally published by The New Stack. Read the full original article here →

NIUS.TV was a non-linear TV news aggregator for mobile devices that converts articles on topics that interest our users into short-form videos using AI. We produced around 100 stories during this period, and more than 500,000 people watched our videos on social media.

An advantage of using this approach is that we can exchange AI systems for new ones without breaking other systems.

To allow quick sharing of assets between steps, we exposed LocalSSDs as k8s volumes mount to pods at all steps in the pipeline.

To coordinate steps in the pipeline, we created a job-manager component (running as a k8s deployment) that listens for messages created by the webApp and other steps.

Made with pure grit © 2024 Jetpack Labs Inc. All rights reserved. www.jetpacklabs.com