fugue-project / fugueLinks
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
☆2,128Updated 3 weeks ago
Alternatives and similar repositories for fugue
Users that are interested in fugue are comparing it to the libraries listed below
Sorting:
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,264Updated this week
- Python Stream Processing☆1,916Updated 8 months ago
- Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two line…☆671Updated 10 months ago
- Making data lake work for time series☆1,186Updated last year
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,512Updated last week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,570Updated last year
- A light-weight, flexible, and expressive statistical data testing library☆4,121Updated last week
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,817Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,607Updated 6 months ago
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆860Updated 2 years ago
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,960Updated 5 months ago
- Hopsworks - Data-Intensive AI platform with a Feature Store☆1,268Updated 10 months ago
- Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and…☆2,333Updated 2 weeks ago
- Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!☆620Updated last week
- Python API for Deequ☆806Updated 8 months ago
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆509Updated 3 months ago
- What's in your data? Extract schema, statistics and entities from datasets☆1,535Updated 2 months ago
- Data Quality assessment with one line of code☆452Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,203Updated this week
- Lightweight and extensible compatibility layer between dataframe libraries!☆1,431Updated this week
- Better SQL in Jupyter. 📊☆833Updated 3 months ago
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆858Updated last year
- Visualise your Kedro data and machine-learning pipelines and track your experiments.☆733Updated this week
- Turning PySpark Into a Universal DataFrame API☆464Updated last week
- PyIceberg☆965Updated this week
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,415Updated this week
- PySpark test helper methods with beautiful error messages☆739Updated 2 weeks ago
- Construct Apache Airflow DAGs Declaratively via YAML configuration files☆1,403Updated last week
- Distributed SQL Engine in Python using Dask☆409Updated last year
- An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model perf…☆2,783Updated 11 months ago