fugue-project / fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
☆2,032Updated 3 months ago
Alternatives and similar repositories for fugue:
Users that are interested in fugue are comparing it to the libraries listed below
- Making data lake work for time series☆1,147Updated 4 months ago
- A light-weight, flexible, and expressive statistical data testing library☆3,546Updated this week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,961Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,066Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,476Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆1,973Updated this week
- Better SQL in Jupyter. 📊☆736Updated last week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,538Updated 3 months ago
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆968Updated last week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,563Updated 8 months ago
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,826Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆2,954Updated this week
- the portable Python dataframe library☆5,451Updated this week
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆863Updated last year
- Distributed SQL Engine in Python using Dask☆396Updated 4 months ago
- Python Stream Processing☆1,605Updated last month
- A curated list of Polars talks, tools, examples & articles. Contributions welcome !☆799Updated last week
- Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two line…☆665Updated 8 months ago
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆854Updated 9 months ago
- Lightweight and extensible compatibility layer between dataframe libraries!☆759Updated this week
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,168Updated this week
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆498Updated 3 months ago
- Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metada…☆1,977Updated this week
- Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!☆503Updated last week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆1,903Updated this week
- Build and share data reports in 100% Python☆1,386Updated last year
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,019Updated this week
- The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-host…☆1,973Updated this week
- An Open Standard for lineage metadata collection☆1,818Updated this week
- Python API for Deequ☆738Updated 3 months ago