dylan-profiler / compressioLinks
Lossless in-memory compression of pandas DataFrames and Series powered by the visions type system. Up to 10x less RAM needed for the same data.
☆29Updated 2 years ago
Alternatives and similar repositories for compressio
Users that are interested in compressio are comparing it to the libraries listed below
Sorting:
- Type System for Data Analysis in Python☆213Updated 6 months ago
- Woodwork is a Python library that provides robust methods for managing and communicating data typing information.☆154Updated 2 weeks ago
- captures logs and makes cron more fun☆78Updated 10 months ago
- A small python library that can clump lists of data together.☆150Updated 3 years ago
- Python package for deduplication/entity resolution using active learning☆81Updated 11 months ago
- pandas data creation by data classes☆53Updated 7 months ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆113Updated last year
- The easiest way to integrate Kedro and Great Expectations☆53Updated 2 years ago
- An abstraction layer for parameter tuning☆35Updated 11 months ago
- Tries to shrink your Pandas column dtypes with no data loss so you have more spare RAM☆84Updated last year
- dagster scikit-learn pipeline example.☆45Updated 2 years ago
- Bulwark is a package for convenient property-based testing of pandas dataframes.☆226Updated 5 years ago
- Abstractions for feature engineering on large graphs of tabular data.☆22Updated 2 months ago
- Function dependencies resolution and execution☆70Updated 5 years ago
- Decorators that logs stats.☆113Updated 4 months ago
- The goal of pandas-log is to provide feedback about basic pandas operations. It provides simple wrapper functions for the most common fun…☆215Updated 4 years ago
- Pipeline components that support partial_fit.☆46Updated last year
- python library for automated dataset normalization☆116Updated 2 years ago
- Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!☆134Updated this week
- Summarise and explore Pandas DataFrames☆98Updated 5 years ago
- SciKIt-learn Pipeline in PAndas☆42Updated last year
- Fuzzy joins for python pandas - easily join different datasets☆59Updated 4 years ago
- A plugin for Flake8 that checks pandas code☆170Updated last year
- Super lightweight function registries for your library☆179Updated last year
- Kedro-Accelerator speeds up pipelines by parallelizing I/O in the background.☆35Updated 3 years ago
- A data modelling layer built on top of polars and pydantic☆198Updated 2 years ago
- A place to provide Coiled feedback☆20Updated 4 months ago
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated last week
- A powerful data analysis package based on mathematical step functions. Strongly aligned with pandas.☆61Updated 7 months ago
- A comprehensive and scalable set of string tokenizers and similarity measures in Python☆140Updated last year