DAGWorks-Inc / hamilton
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
☆1,977Updated this week
Alternatives and similar repositories for hamilton:
Users that are interested in hamilton are comparing it to the libraries listed below
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆863Updated last year
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,433Updated this week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,476Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,032Updated 3 months ago
- Chronon is a data platform for serving for AI/ML applications.☆762Updated this week
- Python Stream Processing☆1,605Updated last month
- Better SQL in Jupyter. 📊☆736Updated last week
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆1,961Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆2,954Updated this week
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,826Updated this week
- Lightweight and extensible compatibility layer between dataframe libraries!☆759Updated this week
- Making data lake work for time series☆1,147Updated 4 months ago
- A light-weight, flexible, and expressive statistical data testing library☆3,546Updated this week
- The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️☆3,538Updated 3 months ago
- The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-host…☆1,973Updated this week
- What's in your data? Extract schema, statistics and entities from datasets☆1,453Updated this week
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,168Updated this week
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆854Updated 9 months ago
- A Pure Python, React-style Framework for Scaling Your Jupyter and Web Apps☆1,962Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆968Updated last week
- 🦘 Explore multimedia datasets at scale☆1,052Updated last month
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆4,119Updated this week
- Turning PySpark Into a Universal DataFrame API☆349Updated this week
- Promptimize is a prompt engineering evaluation and testing toolkit.☆440Updated 3 months ago
- An open-source ML pipeline development platform☆978Updated last week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,563Updated 8 months ago
- ☆299Updated this week
- Titan Core - Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data acces…☆446Updated last week
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,431Updated this week
- Dagster Labs' open-source data platform, built with Dagster.☆301Updated this week