dylan-profiler / compressioLinks
Lossless in-memory compression of pandas DataFrames and Series powered by the visions type system. Up to 10x less RAM needed for the same data.
☆30Updated 3 years ago
Alternatives and similar repositories for compressio
Users that are interested in compressio are comparing it to the libraries listed below
Sorting:
- Type System for Data Analysis in Python☆214Updated 9 months ago
- A small python library that can clump lists of data together.☆151Updated 3 years ago
- Woodwork is a Python library that provides robust methods for managing and communicating data typing information.☆155Updated last month
- The easiest way to integrate Kedro and Great Expectations☆54Updated 2 years ago
- pandas data creation by data classes☆52Updated 10 months ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago
- captures logs and makes cron more fun☆79Updated last year
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated last month
- Python package for deduplication/entity resolution using active learning☆82Updated last year
- Feature engineering library that helps you keep track of feature dependencies, documentation and schema☆28Updated 3 years ago
- Function dependencies resolution and execution☆71Updated 5 years ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated this week
- Fuzzy joins for python pandas - easily join different datasets☆59Updated 5 years ago
- Decorators that logs stats.☆115Updated 8 months ago
- Kedro-Accelerator speeds up pipelines by parallelizing I/O in the background.☆36Updated 3 years ago
- Tries to shrink your Pandas column dtypes with no data loss so you have more spare RAM☆86Updated last year
- A place to provide Coiled feedback☆26Updated 8 months ago
- A maximum-strength name parser for record linkage.☆39Updated 2 months ago
- Automated Jupyter notebook testing. 📙☆41Updated last year
- ☆23Updated last year
- kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.☆28Updated 2 years ago
- SciKIt-learn Pipeline in PAndas☆42Updated 2 years ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆117Updated 3 months ago
- A powerful data analysis package based on mathematical step functions. Strongly aligned with pandas.☆63Updated 10 months ago
- The goal of pandas-log is to provide feedback about basic pandas operations. It provides simple wrapper functions for the most common fun…☆216Updated 4 years ago
- Code examples showing flow deployment to various types of infrastructure☆111Updated 2 years ago
- Typed wrappers over pandas DataFrames with schema validation☆102Updated 2 years ago
- Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!☆138Updated this week
- Pipeline components that support partial_fit.☆46Updated last year
- Run pytest against markdown files/docstrings.☆141Updated this week