hi-primus / optimus
Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
☆1,501Updated 4 months ago
Alternatives and similar repositories for optimus:
Users that are interested in optimus are comparing it to the libraries listed below
- Clean APIs for data cleaning. Python implementation of R package Janitor☆1,410Updated this week
- A Python package for manipulating 2-dimensional tabular data structures☆1,824Updated 3 weeks ago
- Python library for building highly effective data science workflows☆950Updated last year
- python implementation of the parquet columnar file format.☆821Updated 3 weeks ago
- Real-time stream processing for python☆1,257Updated 4 months ago
- Jupyter magics and kernels for working with remote Spark clusters☆1,348Updated last month
- Easy pipelines for pandas DataFrames.☆719Updated 5 months ago
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,037Updated last month
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,067Updated 2 weeks ago
- A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow☆2,077Updated last year
- MLeap: Deploy ML Pipelines to Production☆1,516Updated 4 months ago
- Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.☆515Updated last week
- NumPy and Pandas interface to Big Data☆3,199Updated last year
- Data Analysis Baseline Library☆726Updated 3 months ago
- Scalable Machine Learning with Dask☆927Updated 2 months ago
- Dask tutorial☆1,851Updated last year
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆629Updated 2 weeks ago
- Monitor the stability of a Pandas or Spark dataframe ⚙︎☆500Updated 2 months ago
- Python Extract Transform and Load Tables of Data☆1,263Updated last week
- Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io☆2,058Updated this week
- sqldf for pandas☆1,347Updated 8 months ago
- A light-weight, flexible, and expressive statistical data testing library☆3,747Updated last week
- Quilt is a data mesh for connecting people with actionable data☆1,333Updated this week
- bamboolib - a GUI for pandas DataFrames☆946Updated last year
- Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!☆540Updated 2 weeks ago
- PySpark + Scikit-learn = Sparkit-learn☆1,154Updated 4 years ago
- A library for debugging/inspecting machine learning classifiers and explaining their predictions☆2,770Updated 2 years ago
- Python API for Deequ☆761Updated 2 weeks ago
- Sparkling Water provides H2O functionality inside Spark cluster☆969Updated 4 months ago
- Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.☆3,398Updated 2 weeks ago