fugue-project / fugueLinks
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
☆2,082Updated 2 months ago
Alternatives and similar repositories for fugue
Users that are interested in fugue are comparing it to the libraries listed below
Sorting:
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,099Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,831Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,858Updated this week
- Making data lake work for time series☆1,171Updated 9 months ago
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,344Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,082Updated this week
- the portable Python dataframe library☆5,798Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,300Updated this week
- Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two line…☆667Updated 3 months ago
- Python API for Deequ☆771Updated last month
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆501Updated 4 months ago
- re_data - fix data issues before your users & CEO would discover them 😊☆1,561Updated last year
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,900Updated 2 weeks ago
- Python Stream Processing☆1,745Updated 2 months ago
- An open protocol for secure data sharing☆836Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,583Updated this week
- Hopsworks - Data-Intensive AI platform with a Feature Store☆1,225Updated 3 months ago
- Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!☆572Updated last week
- What's in your data? Extract schema, statistics and entities from datasets☆1,492Updated 2 months ago
- Distributed SQL Engine in Python using Dask☆405Updated 9 months ago
- Always know what to expect from your data.☆10,415Updated last week
- Clean APIs for data cleaning. Python implementation of R package Janitor☆1,425Updated this week
- Construct Apache Airflow DAGs Declaratively via YAML configuration files☆1,296Updated this week
- Visualise your Kedro data and machine-learning pipelines and track your experiments.☆716Updated this week
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,216Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,695Updated this week
- The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-host…☆2,077Updated this week
- Apache PyIceberg☆750Updated this week
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆861Updated last year
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,425Updated last month