Eventual-Inc / DaftLinks
Distributed query engine providing simple and reliable data processing for any modality and scale
☆3,064Updated this week
Alternatives and similar repositories for Daft
Users that are interested in Daft are comparing it to the libraries listed below
Sorting:
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,984Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,850Updated this week
- Python Stream Processing☆1,774Updated 3 months ago
- Making data lake work for time series☆1,174Updated 10 months ago
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,093Updated 3 months ago
- Apache DataFusion Ballista Distributed Query Engine☆1,787Updated last week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,347Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,456Updated this week
- Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and…☆2,178Updated this week
- Apache DataFusion Comet Spark Accelerator☆988Updated this week
- Apache PyIceberg☆799Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆824Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,355Updated 2 weeks ago
- 🦆 A curated list of awesome DuckDB resources☆1,909Updated last week
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now a Linux Foundation project.☆1,329Updated this week
- DuckLake is an integrated data lake and catalog format☆1,756Updated last week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,108Updated last week
- Apache DataFusion SQL Query Engine☆7,436Updated this week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆768Updated this week
- GlareDB: A light and fast SQL database for analytics☆928Updated last week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,846Updated this week
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,924Updated last week
- Chronon is a data platform for serving for AI/ML applications.☆818Updated last week
- Malloy is an experimental language for describing data relationships and transformations.☆2,184Updated this week
- DuckDB-powered Postgres for high performance apps & analytics.☆2,363Updated last week
- Lightweight and extensible compatibility layer between dataframe libraries!☆1,159Updated this week
- Apache Iceberg☆1,008Updated this week
- Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.☆2,123Updated this week
- the portable Python dataframe library☆5,913Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,580Updated this week