apache / hamiltonLinks
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
☆2,325Updated this week
Alternatives and similar repositories for hamilton
Users that are interested in hamilton are comparing it to the libraries listed below
Sorting:
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆860Updated 2 years ago
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,126Updated this week
- Python Stream Processing☆1,895Updated 8 months ago
- An open-source ML pipeline development platform☆997Updated 10 months ago
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,955Updated 5 months ago
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,854Updated last week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,607Updated 6 months ago
- Lightweight and extensible compatibility layer between dataframe libraries!☆1,394Updated last week
- A light-weight, flexible, and expressive statistical data testing library☆4,098Updated last week
- Making data lake work for time series☆1,185Updated last year
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,723Updated last week
- Chronon is a data platform for serving for AI/ML applications.☆942Updated last week
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,800Updated this week
- What's in your data? Extract schema, statistics and entities from datasets☆1,529Updated 2 months ago
- Python Streaming DataFrames for Kafka☆1,493Updated 2 weeks ago
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆858Updated last year
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,242Updated last week
- Distribute and run AI workloads on Kubernetes magically in Python, like PyTorch for ML infra.☆1,115Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,280Updated this week
- Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two line…☆670Updated 9 months ago
- A data modelling layer built on top of polars and pydantic☆572Updated 3 months ago
- Better SQL in Jupyter. 📊☆829Updated 2 months ago
- dstack is an open-source control plane for running development, training, and inference jobs on GPUs—across hyperscalers, neoclouds, or o…☆1,971Updated last week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,487Updated last week
- Analytics, Versioning and ETL for multimodal data: video, audio, PDFs, images☆2,704Updated last week
- The simplest way to serve AI/ML models in production☆1,090Updated last week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆4,615Updated last week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,193Updated this week
- A curated list of Polars talks, tools, examples & articles. Contributions welcome !☆1,024Updated last week
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆4,860Updated last week