DAGWorks-Inc / hamilton
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
☆2,093Updated 2 weeks ago
Alternatives and similar repositories for hamilton:
Users that are interested in hamilton are comparing it to the libraries listed below
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆861Updated last year
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,575Updated 3 weeks ago
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,072Updated 3 weeks ago
- A light-weight, flexible, and expressive statistical data testing library☆3,754Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,736Updated this week
- Python Stream Processing☆1,710Updated 3 weeks ago
- Scalable and efficient data transformation framework - backwards compatible with dbt.☆2,242Updated this week
- Lightweight and extensible compatibility layer between dataframe libraries!☆928Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,472Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆1,049Updated last week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,556Updated 7 months ago
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆850Updated last year
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,880Updated this week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,454Updated this week
- Chronon is a data platform for serving for AI/ML applications.☆790Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆2,032Updated this week
- Time-series machine learning at scale. Built with Polars for embarrassingly parallel feature extraction and forecasts on panel data.☆1,093Updated 9 months ago
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,215Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,063Updated this week
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,200Updated last week
- A curated list of Polars talks, tools, examples & articles. Contributions welcome !☆854Updated 3 weeks ago
- Temporian is an open-source Python library for preprocessing ⚡ and feature engineering 🛠 temporal data 📈 for machine learning applicati…☆691Updated 8 months ago
- An open-source ML pipeline development platform☆987Updated 3 months ago
- A reactive Python kernel for Jupyter notebooks.☆1,212Updated this week
- Better SQL in Jupyter. 📊☆768Updated 3 weeks ago
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,559Updated this week
- A Pure Python, React-style Framework for Scaling Your Jupyter and Web Apps☆2,022Updated this week
- No-code in the front, Python in the back. An open-source framework for creating data apps.☆1,393Updated this week
- Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.☆2,008Updated this week
- Build and share data reports in 100% Python☆1,393Updated last year