Newest TLP provides high performance shuffling services for cloud native architectures

Apache Software Foundation has announced the graduation of Apache Uniffle from incubation to a Top-Level Project (TLP). This project serves as a high-performance, general-purpose remote shuffle service for distributed computing engines. Uniffle aims to reduce connections and random I/O during data shuffle tasks while minimizing memory failures in large jobs. The service processes significant amounts of data daily and is utilized by various companies, including Tencent and Didi.

He Qi, Apache Uniffle PMC Chair, expressed pride in Uniffle's advancement within the ASF, stating, “We are excited to continue innovating to provide efficient and pervasive cloud shuffling services.” The project supports data frameworks such as Apache Hadoop and Apache Spark.

The ASF fosters healthy communities for open-source projects, offering services and mentorship to help projects thrive throughout their lifecycle. The Apache Incubator facilitates newcomers wishing to adopt the Apache Way.