fugue-project / fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
☆1,968Updated last month
Related projects: ⓘ
- A light-weight, flexible, and expressive statistical data testing library☆3,258Updated this week
- Making data lake work for time series☆1,121Updated 3 weeks ago
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,479Updated 2 months ago
- Distributed DataFrame for Python designed for the cloud, powered by Rust☆2,080Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,866Updated last week
- Python Stream Processing☆1,467Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆1,933Updated this week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,612Updated this week
- Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two line…☆661Updated 4 months ago
- What's in your data? Extract schema, statistics and entities from datasets☆1,418Updated 2 months ago
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆863Updated last year
- the portable Python dataframe library☆5,064Updated this week
- Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metada…☆1,723Updated this week
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆493Updated 2 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,540Updated 4 months ago
- Python API for Deequ☆704Updated last week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆860Updated this week
- Better SQL in Jupyter. 📊☆693Updated last week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆3,789Updated this week
- Visualise your Kedro data and machine-learning pipelines and track your experiments.☆666Updated this week
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,793Updated this week
- Build and share data reports in 100% Python☆1,369Updated 11 months ago
- An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model perf…☆2,628Updated this week
- Hopsworks - Data-Intensive AI platform with a Feature Store☆1,135Updated last week
- A native Rust library for Delta Lake, with bindings into Python☆2,155Updated this week
- Distributed SQL Engine in Python using Dask☆385Updated 3 weeks ago
- Clean APIs for data cleaning. Python implementation of R package Janitor☆1,343Updated this week
- Pandas, Polars, and Spark DataFrame comparison for humans and more!☆466Updated last week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆2,307Updated this week
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,272Updated this week