Skip to content
@vortex-data

Vortex

Vortex is an extensible, state-of-the-art columnar format meant to replace Apache Parquet. Formerly at @spiraldb, now part of the Linux Foundation.
README.md

🌪️ Vortex

📚 Documentation | 📊 Performance Benchmarks

Overview

Vortex is a next-generation columnar file format and toolkit designed for high-performance data analytics. It provides:

  • ⚡️ Blazing Fast Performance

    • 100-200x faster random access reads than Apache Parquet
    • 2-10x faster scans with similar compression ratios and write throughput
    • Efficient support for wide tables with zero-copy/zero-parse metadata

  • 🔧 Extensible Architecture

    • Modeled after Apache DataFusion's extensible approach
    • Pluggable encoding system
    • Zero-copy compatibility with Apache Arrow

Project Information

License

Licensed under the Apache License, Version 2.0

Governance

Vortex is an independent open-source project and not controlled by any single company. The Vortex Project is a sub-project of the Linux Foundation Projects. The governance model is documented in CONTRIBUTING.md and is subject to the terms of the Technical Charter.

Contributing

See CONTRIBUTING.md for guidelines.

Acknowledgments 🏆

This project builds upon groundbreaking work from the academic and open-source communities:

Key Research Papers

Open Source Inspiration

Trademarks

Copyright © Vortex a Series of LF Projects, LLC For web site terms of use, trademark policy and other project policies please see https://lfprojects.org

Thanks to all contributors who have shared their knowledge and code with the community! 🚀

Pinned Loading

  1. vortex vortex Public

    An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

    Rust 1.8k 67

Repositories

Showing 7 of 7 repositories
  • vortex Public

    An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.

    vortex-data/vortex’s past year of commit activity
    Rust 1,763 Apache-2.0 67 170 (8 issues need help) 36 Updated Sep 29, 2025
  • duckdb-vortex Public

    DuckDB extension allowing reading/writing of vortex files

    vortex-data/duckdb-vortex’s past year of commit activity
    Shell 25 MIT 0 2 4 Updated Sep 29, 2025
  • vortex.dev Public

    Source code for https://vortex.dev

    vortex-data/vortex.dev’s past year of commit activity
    TypeScript 0 0 0 3 Updated Sep 29, 2025
  • community-extensions Public Forked from duckdb/community-extensions
    vortex-data/community-extensions’s past year of commit activity
    Shell 0 76 0 0 Updated Sep 26, 2025
  • tpchgen-rs Public Forked from clflushopt/tpchgen-rs

    TPC-H benchmark data generation in pure Rust

    vortex-data/tpchgen-rs’s past year of commit activity
    Rust 0 Apache-2.0 44 0 0 Updated Aug 30, 2025
  • ClickBench Public Forked from ClickHouse/ClickBench

    ClickBench: a Benchmark For Analytical Databases

    vortex-data/ClickBench’s past year of commit activity
    HTML 0 230 0 0 Updated Aug 14, 2025
  • .github Public
    vortex-data/.github’s past year of commit activity
    0 0 0 0 Updated May 15, 2025

Most used topics

Loading…