MinishLab / semhashLinks
Fast Semantic Text Deduplication & Filtering
☆823Updated 3 weeks ago
Alternatives and similar repositories for semhash
Users that are interested in semhash are comparing it to the libraries listed below
Sorting:
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,368Updated last month
- Late Interaction Models Training & Retrieval☆632Updated this week
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆400Updated this week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,562Updated 5 months ago
- Fast State-of-the-Art Static Embeddings☆1,882Updated 3 weeks ago
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆877Updated last month
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆827Updated 9 months ago
- Easily embed, cluster and semantically label text datasets☆581Updated last year
- Code for explaining and evaluating late chunking (chunked pooling)☆453Updated 10 months ago
- 🤗 Benchmark Large Language Models Reliably On Your Data☆408Updated 3 weeks ago
- Build datasets using natural language☆541Updated last month
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆338Updated 5 months ago
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,073Updated 8 months ago
- A very simple news crawler with a funny name☆415Updated this week
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆190Updated last year
- Simple UI for debugging correlations of text embeddings☆296Updated 5 months ago
- A small library of LLM judges☆296Updated 3 months ago
- Bringing BERT into modernity via both architecture changes and scaling☆1,549Updated 4 months ago
- awesome synthetic (text) datasets☆302Updated 3 months ago
- Train Models Contrastively in Pytorch☆753Updated 7 months ago
- ⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍☆605Updated 2 months ago
- Automated Evaluation of RAG Systems☆667Updated 7 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆442Updated last year
- LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR t…☆490Updated 8 months ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,006Updated 6 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆545Updated this week
- ☆238Updated 4 months ago
- Lightweight Nearest Neighbors with Flexible Backends☆312Updated 3 weeks ago
- Use LOTUS to process all of your datasets with LLMs and embeddings. Enjoy up to 1000x speedups with fast, accurate query processing, that…☆1,327Updated 2 weeks ago
- OCR Benchmark☆584Updated last week