asf-transfer / hamilton
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
☆2,130Updated this week
Alternatives and similar repositories for hamilton
Users that are interested in hamilton are comparing it to the libraries listed below
Sorting:
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆861Updated last year
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,081Updated last month
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,597Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,827Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,807Updated this week
- Python Stream Processing☆1,738Updated last month
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,590Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,571Updated 8 months ago
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,301Updated this week
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,893Updated this week
- Making data lake work for time series☆1,168Updated 8 months ago
- Lightweight and extensible compatibility layer between dataframe libraries!☆981Updated this week
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,585Updated this week
- What's in your data? Extract schema, statistics and entities from datasets☆1,485Updated last month
- Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. Fro…☆6,149Updated this week
- Time-series machine learning at scale. Built with Polars for embarrassingly parallel feature extraction and forecasts on panel data.☆1,105Updated 10 months ago
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,085Updated this week
- Scalable identity resolution, entity resolution, data mastering and deduplication using ML☆1,029Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,076Updated last week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,250Updated this week
- Chronon is a data platform for serving for AI/ML applications.☆801Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,057Updated this week
- Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipeli…☆637Updated 2 weeks ago
- the portable Python dataframe library☆5,751Updated this week
- Python Streaming DataFrames for Kafka☆1,372Updated this week
- ETL, Analytics, Versioning for Unstructured Data☆2,551Updated this week
- An open-source ML pipeline development platform☆989Updated 4 months ago
- Better SQL in Jupyter. 📊☆777Updated last month
- A reactive Python kernel for Jupyter notebooks.☆1,222Updated last month
- Promptimize is a prompt engineering evaluation and testing toolkit.☆461Updated last month