apache / hamiltonLinks
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
☆2,148Updated this week
Alternatives and similar repositories for hamilton
Users that are interested in hamilton are comparing it to the libraries listed below
Sorting:
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆861Updated last year
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,082Updated 2 months ago
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,616Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,858Updated this week
- Python Stream Processing☆1,751Updated 2 months ago
- Making data lake work for time series☆1,171Updated 9 months ago
- An open-source ML pipeline development platform☆988Updated 4 months ago
- A reactive Python kernel for Jupyter notebooks.☆1,223Updated last month
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,344Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,662Updated this week
- Chronon is a data platform for serving for AI/ML applications.☆809Updated 2 weeks ago
- Malloy is an experimental language for describing data relationships and transformations.☆2,158Updated this week
- Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake…☆654Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,086Updated this week
- Lightweight and extensible compatibility layer between dataframe libraries!☆1,039Updated this week
- Better SQL in Jupyter. 📊☆780Updated 2 months ago
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆852Updated last year
- A data modelling layer built on top of polars and pydantic☆458Updated 4 months ago
- What's in your data? Extract schema, statistics and entities from datasets☆1,492Updated 2 months ago
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,583Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,083Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,831Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,099Updated this week
- the portable Python dataframe library☆5,798Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,300Updated last week
- Turning PySpark Into a Universal DataFrame API☆403Updated this week
- The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-host…☆2,077Updated this week
- Promptimize is a prompt engineering evaluation and testing toolkit.☆464Updated 2 months ago
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,216Updated this week
- A curated list of Polars talks, tools, examples & articles. Contributions welcome !☆872Updated last week