fugue-project / fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
☆2,013Updated last month
Related projects ⓘ
Alternatives and complementary repositories for fugue
- Making data lake work for time series☆1,139Updated 3 months ago
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,336Updated this week
- Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two line…☆663Updated 6 months ago
- A light-weight, flexible, and expressive statistical data testing library☆3,401Updated this week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,824Updated this week
- Build and share data reports in 100% Python☆1,381Updated last year
- Distributed SQL Engine in Python using Dask☆397Updated 2 months ago
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆3,964Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,015Updated this week
- the portable Python dataframe library☆5,318Updated this week
- Python Stream Processing☆1,565Updated this week
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆863Updated last year
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆923Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,913Updated this week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,552Updated 6 months ago
- Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metada…☆1,874Updated this week
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,481Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,325Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,511Updated 2 months ago
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆497Updated last month
- Python API for Deequ☆730Updated last month
- Better SQL in Jupyter. 📊☆723Updated last week
- Apache PyIceberg☆473Updated this week
- What's in your data? Extract schema, statistics and entities from datasets☆1,434Updated last week
- ☆704Updated 2 years ago
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,205Updated this week
- Malloy is an experimental language for describing data relationships and transformations.☆1,996Updated this week
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,818Updated this week
- Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!☆484Updated this week
- Lightweight and extensible compatibility layer between dataframe libraries!☆605Updated this week