YuniKorn: Alternative to Kubernetes’ Default Scheduler for Big Data, ML

3 years ago thenewstack.io

Summary: This is a summary of an article originally published by The New Stack. Read the full original article here →

The big data and machine learning resource scheduler https://yunikorn.apache.org/ has attained https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces82 within the Apache Software Foundation and released its 1.0 version. YuniKorn is a https://github.com/apache/yunikorn-core for machine learning and big data applications.

Optimized to run Apache Spark on Kubernetes, Apache YuniKorn’s performance makes it an optional replacement to the Kubernetes default scheduler.

Hierarchical resource queues — It efficiently manages cluster resources and provides the ability to control resource consumption for each tenant.

Features of the recently released 1.0 version, the fifth update since entering the Apache Incubator, include: Decreased memory and CPU usage

DevOps Articles