dylan-profiler / compressioLinks
Lossless in-memory compression of pandas DataFrames and Series powered by the visions type system. Up to 10x less RAM needed for the same data.
☆30Updated 3 years ago
Alternatives and similar repositories for compressio
Users that are interested in compressio are comparing it to the libraries listed below
Sorting:
- Type System for Data Analysis in Python☆215Updated last year
- Woodwork is a Python library that provides robust methods for managing and communicating data typing information.☆155Updated 4 months ago
- Python package for deduplication/entity resolution using active learning☆83Updated last year
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated last month
- A small python library that can clump lists of data together.☆148Updated 4 years ago
- The easiest way to integrate Kedro and Great Expectations☆54Updated 3 years ago
- captures logs and makes cron more fun☆81Updated last week
- Function dependencies resolution and execution☆71Updated 5 years ago
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆114Updated 3 months ago
- Automated Jupyter notebook testing. 📙☆40Updated 2 years ago
- Fuzzy joins for python pandas - easily join different datasets☆59Updated 5 years ago
- kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.☆28Updated 3 years ago
- python library for automated dataset normalization☆117Updated 2 years ago
- dagster scikit-learn pipeline example.☆46Updated 2 years ago
- Tries to shrink your Pandas column dtypes with no data loss so you have more spare RAM☆86Updated 2 years ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago
- Kedro-Accelerator speeds up pipelines by parallelizing I/O in the background.☆36Updated 3 years ago
- An abstraction layer for parameter tuning☆35Updated last month
- quadipy is a python package to help transform structured data into RDF graph format☆19Updated 2 years ago
- ☆22Updated 3 weeks ago
- Kedro Wings automatically creates catalog entries to simplify Kedro pipeline writing. See the video here: https://www.youtube.com/watch?v…☆21Updated 3 years ago
- pandas data creation by data classes☆51Updated last year
- Cloud-agnostic Python API☆60Updated last year
- Bulwark is a package for convenient property-based testing of pandas dataframes.☆226Updated 5 years ago
- openclean - Data Cleaning and data profiling library for Python☆83Updated 4 years ago
- Automatically export Jupyter notebooks to various file formats (.py, .html, and more) on save.☆84Updated 4 months ago
- A plugin for Flake8 that checks pandas code☆170Updated 2 years ago
- Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!☆139Updated this week
- A xlsx and html rendering library for rendering data available in Pandas DataFrames.☆25Updated last year
- Code examples showing flow deployment to various types of infrastructure☆110Updated 3 years ago