MinishLab / semhash
Fast Semantic Text Deduplication
☆545Updated this week
Alternatives and similar repositories for semhash:
Users that are interested in semhash are comparing it to the libraries listed below
- Fast State-of-the-Art Static Embeddings☆1,077Updated this week
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,314Updated last week
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,033Updated last month
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆251Updated 2 weeks ago
- Easily embed, cluster and semantically label text datasets☆511Updated 11 months ago
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆741Updated last month
- Late Interaction Models Training & Retrieval☆249Updated this week
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆259Updated 2 months ago
- Code for explaining and evaluating late chunking (chunked pooling)☆331Updated 2 months ago
- LOTUS: A semantic query engine for fast and easy LLM-powered data processing☆1,094Updated this week
- ☆207Updated 8 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆407Updated last year
- A very simple news crawler with a funny name☆351Updated this week
- Build datasets using natural language☆396Updated last week
- awesome synthetic (text) datasets☆263Updated 4 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,238Updated this week
- ☆210Updated 2 months ago
- A Lightweight Library for AI Observability☆233Updated last week
- ☆150Updated 3 months ago
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆756Updated 3 months ago
- Lightweight Nearest Neighbors with Flexible Backends☆244Updated this week
- 📚 Process PDFs, Word documents and more with spaCy☆442Updated this week
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,049Updated last month
- A prompting library☆155Updated 5 months ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆171Updated 6 months ago
- Bringing BERT into modernity via both architecture changes and scaling☆1,240Updated last week
- FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes☆188Updated 4 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆151Updated 5 months ago
- A Comprehensive Benchmark for Document Parsing and Evaluation☆261Updated last week
- An Awesome list of curated DSPy resources.☆288Updated last week