Apache Auron (Incubating)

Welcome to your VuePress site

Key Features
Performance Icon Performance
  • Supports most native operators/expressions and fine-grained failback.
  • Powered by Rust, 2x faster on TPC-DS benchmark.
  • Performs significantly better in production environments.
Production ready Icon Production ready
  • Verified on production environments with exabytes of data.
  • Supports complex production scenarios like JSON parsing, UDF/UDTF, etc.
  • Resolved various stability and data consistency issues.
Easy to Use Icon Easy to Use
  • Simple to build and install to Spark.
  • Easy to configuration.
  • Full-featured execution metrics.
Compatibility Icon Compatibility
  • Adapted to Spark mainline versions.
  • Supports different storage systems like HDFS, S3, etc.
Ecology Icon Ecosystem
  • Supports data lake system like Hudi, Paimon.
  • Supports Remote Shuffle Service like Apache Celeborn.
Development Icon Community
  • Some cooperators have applied Auron on production.
  • More are researching and evaluating Auron.
Benchmarks
Auron has passed all TPC-DS/TPC-H benchmark cases. Comparing to Spark-3.5, Auron is running ~2x faster and save ~50% cluster resources. See Benchmark Details.
Apache Incubator logo

Apache Auron is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

Copyright © 2025 The Apache Software Foundation, Licensed under the Apache License, Version 2.0.

Apache, the names of Apache projects, and the feather logo are either registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other marks mentioned may be trademarks or registered trademarks of their respective owners.