fugue-project / fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
☆2,077Updated last month
Alternatives and similar repositories for fugue:
Users that are interested in fugue are comparing it to the libraries listed below
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,083Updated this week
- Making data lake work for time series☆1,167Updated 8 months ago
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,245Updated this week
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆861Updated last year
- Python Stream Processing☆1,723Updated last month
- What's in your data? Extract schema, statistics and entities from datasets☆1,484Updated last month
- Python API for Deequ☆766Updated last month
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,808Updated this week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,293Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,777Updated last week
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,891Updated this week
- Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two line…☆666Updated 2 months ago
- the portable Python dataframe library☆5,723Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,068Updated this week
- ☆704Updated 2 years ago
- Build and share data reports in 100% Python☆1,392Updated last year
- An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model perf…☆2,712Updated 3 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,563Updated last year
- Distributed SQL Engine in Python using Dask☆404Updated 8 months ago
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆500Updated 3 months ago
- UnionML: the easiest way to build and deploy machine learning microservices☆335Updated last year
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,563Updated 7 months ago
- Turning PySpark Into a Universal DataFrame API☆390Updated last week
- Better SQL in Jupyter. 📊☆774Updated last month
- An Open Standard for lineage metadata collection☆1,928Updated this week
- Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metada…☆2,123Updated last month
- An open protocol for secure data sharing☆833Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,507Updated 5 months ago
- 🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞☆720Updated last year
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,584Updated this week