DAGWorks-Inc / hamilton
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
☆2,025Updated last week
Alternatives and similar repositories for hamilton:
Users that are interested in hamilton are comparing it to the libraries listed below
- A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton☆861Updated last year
- Efficient data transformation and modeling framework that is backwards compatible with dbt.☆2,081Updated this week
- Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastr…☆1,505Updated last week
- Distributed data engine for Python/SQL designed for the cloud, powered by Rust☆2,545Updated this week
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,040Updated 4 months ago
- Python Stream Processing☆1,637Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆3,623Updated this week
- Lightweight and extensible compatibility layer between dataframe libraries!☆820Updated this week
- data load tool (dlt) is an open source Python library that makes data loading easy 🛠️☆3,186Updated this week
- dbt (http://getdbt.com) adapter for DuckDB (http://duckdb.org)☆992Updated this week
- Chronon is a data platform for serving for AI/ML applications.☆773Updated this week
- Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to wr…☆1,954Updated this week
- Making data lake work for time series☆1,152Updated 5 months ago
- Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.☆1,864Updated this week
- MetricFlow allows you to define, build, and maintain metrics in code.☆1,180Updated this week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,016Updated this week
- dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem…☆1,687Updated this week
- re_data - fix data issues before your users & CEO would discover them 😊☆1,565Updated 9 months ago
- An open-source ML pipeline development platform☆979Updated last month
- What's in your data? Extract schema, statistics and entities from datasets☆1,458Updated last week
- Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends☆1,469Updated this week
- Malloy is an experimental language for describing data relationships and transformations.☆2,056Updated this week
- Turning PySpark Into a Universal DataFrame API☆366Updated this week
- Better SQL in Jupyter. 📊☆746Updated last week
- do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning m…☆854Updated 10 months ago
- The Virtual Feature Store. Turn your existing data infrastructure into a feature store.☆1,846Updated this week
- Port(ish) of Great Expectations to dbt test macros☆1,139Updated 2 months ago
- Titan Core - Snowflake infrastructure-as-code. Provision environments, automate deploys, CI/CD. Manage RBAC, users, roles, and data acces…☆454Updated last month
- Apache PyIceberg☆596Updated this week
- 🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞☆718Updated last year