fugue-project / fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
☆2,067Updated 2 weeks ago
Alternatives and similar repositories for fugue:
Users that are interested in fugue are comparing it to the libraries listed below
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,058Updated this week
- Making data lake work for time series☆1,163Updated 7 months ago
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,707Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,228Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,211Updated this week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,563Updated 11 months ago
- the portable Python dataframe library☆5,684Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,049Updated last week
- A light-weight, flexible, and expressive statistical data testing library☆3,747Updated last week
- Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two line…☆666Updated last month
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,454Updated this week
- Python Stream Processing☆1,710Updated 3 weeks ago
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆861Updated last year
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,878Updated this week
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,197Updated this week
- Python API for Deequ☆761Updated 2 weeks ago
- Hopsworks - Data-Intensive AI platform with a Feature Store☆1,219Updated 2 months ago
- Distributed SQL Engine in Python using Dask☆401Updated 7 months ago
- Dynamically generate Apache Airflow DAGs from YAML configuration files☆1,274Updated this week
- An open protocol for secure data sharing☆821Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,558Updated 6 months ago
- Malloy is an experimental language for describing data relationships and transformations.☆2,120Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,671Updated this week
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆850Updated last year
- Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metada…☆2,093Updated last week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,182Updated this week
- An Open Standard for lineage metadata collection☆1,902Updated this week
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆500Updated 2 months ago
- Turning PySpark Into a Universal DataFrame API☆382Updated this week
- The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-host…☆2,043Updated last week