High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datasets
☆237Mar 10, 2026Updated last week
Alternatives and similar repositories for rensa
Users that are interested in rensa are comparing it to the libraries listed below
Sorting:
- Fast Multimodal Semantic Deduplication & Filtering☆897Jan 20, 2026Updated 2 months ago
- Locality Sensitive Hashing☆79Jul 12, 2023Updated 2 years ago
- Compute bottom-s sketches and s-buckets sketches, using simd-minimizers crate.☆21Dec 3, 2025Updated 3 months ago
- ☆27Nov 4, 2024Updated last year
- 🌳 A compressed rank/select dictionary exploiting approximate linearity and repetitiveness.☆15Jun 28, 2022Updated 3 years ago
- reimagine the implementation of C-3PO droid voice synthesizer and multilingual translation and communication capabilities with the latest…☆12Mar 6, 2024Updated 2 years ago
- ☆1,262Jul 30, 2024Updated last year
- Surgically de-slop LLMs☆14Jun 1, 2025Updated 9 months ago
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆125Nov 13, 2025Updated 4 months ago
- All-in-one text de-duplication☆745Mar 9, 2026Updated last week
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆116Dec 30, 2023Updated 2 years ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆283Jul 11, 2024Updated last year
- Rust implementation of Simhash☆24Mar 9, 2026Updated last week
- R integration for edlib, a C/C++ library for pairwise sequence alignment using edit distance (Levenshtein distance).☆11Jul 20, 2025Updated 7 months ago
- Taxonomy classification of viral sequences / contigs☆12Jul 15, 2025Updated 8 months ago
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆37Jan 13, 2025Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,121Mar 9, 2026Updated last week
- ☆19Aug 7, 2024Updated last year
- PromptMII: Meta-Learning Instruction Induction for LLMs☆47Jan 12, 2026Updated 2 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,956Updated this week
- ☆29Mar 12, 2026Updated last week
- A framework for optimizing DSPy programs with RL☆326Jan 12, 2026Updated 2 months ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)☆20Mar 15, 2025Updated last year
- ☆10Jun 9, 2025Updated 9 months ago
- Fast approximate joins on string columns for polars dataframes.☆16Dec 24, 2025Updated 2 months ago
- An implementation of "Subspace Representations for Soft Set Operations and Sentence Similarities" (NAACL 2024)☆10May 31, 2024Updated last year
- BLEU Score in Rust☆12Mar 1, 2026Updated 2 weeks ago
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.☆14Mar 20, 2024Updated 2 years ago
- Using short models to classify long texts☆21Mar 8, 2023Updated 3 years ago
- NSA Triton Kernels written with GPT5 and Opus 4.1☆71Aug 12, 2025Updated 7 months ago
- ☆120Feb 25, 2026Updated 3 weeks ago
- Development repo for pyani-plus (the next iteration of pyani)☆25Mar 11, 2026Updated last week
- Rust library providing fast language model queries in compressed space☆25Oct 1, 2022Updated 3 years ago
- Fast and Memory Efficient Genome Sketching via HyperLogLog, HyperMinHash and UltraLogLog☆20Jan 22, 2026Updated last month
- Lottery Ticket Adaptation☆40Nov 20, 2024Updated last year
- plane sweep filtering genome alignments☆23Updated this week
- Memory optimized Mixture of Experts☆75Jul 25, 2025Updated 7 months ago
- Genetics for Language Models☆17Jul 1, 2024Updated last year
- A minimal implementation of spotify/annoy in pure rust☆11Mar 2, 2023Updated 3 years ago