ayushgupta4897 / fast-dedupeLinks
A minimalist but optimized Python package for deduplication tasks leveraging RapidFuzz internally, enabling super-fast approximate duplicate detection within a dataset with minimal config.
☆18Updated 9 months ago
Alternatives and similar repositories for fast-dedupe
Users that are interested in fast-dedupe are comparing it to the libraries listed below
Sorting:
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆119Updated 9 months ago
- synthetic data for ml☆25Updated 11 months ago
- Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, ba…☆265Updated last week
- Tool to migrate data into Qdrant☆65Updated last week
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆141Updated 5 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆34Updated last year
- this project will bootstrap and scaffold the projects for specific semantic search and RAG applications along with regular boiler plate c…☆92Updated last year
- ☆38Updated last year
- ☆97Updated 3 months ago
- Deep Research for your internal data☆353Updated 7 months ago
- Simple UI for debugging correlations of text embeddings☆305Updated 8 months ago
- LitePali is a minimal, efficient implementation of ColPali for image retrieval and indexing, optimized for cloud deployment.☆121Updated last year
- Drift detection module for machine learning pipelines.☆24Updated 2 years ago
- Kura is a simple reproduction of the CLIO paper which uses language models to label user behaviour before clustering them based on embedd…☆414Updated 4 months ago
- A curated list of open source repositories for AI Engineers☆124Updated 10 months ago
- The Idea Behind Parameter Efficient Fine-Tuning and Analyzing LoRA through its Implementation on an MLP☆36Updated 6 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆184Updated last year
- SUQL: Conversational Search over Structured and Unstructured Data with LLMs☆296Updated last week
- A Lightweight Library for AI Observability☆255Updated 11 months ago
- Iterate fast on your RAG pipelines☆24Updated 7 months ago
- A collection of architectural patterns leveraging Large Language Models (LLMs) for efficient Text-to-SQL generation.☆255Updated 2 years ago
- Generalist and Lightweight Model for Text Classification☆168Updated 2 weeks ago
- Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…☆348Updated 4 months ago
- Data management with LLMs☆182Updated last year
- Named Entity Recognition using Claude Citations☆79Updated 7 months ago
- A small library of LLM judges☆317Updated 5 months ago
- ☆18Updated last year
- Declarative context engineering for agents☆434Updated last week
- A structured framework for defining, verifying and certifying AI systems.☆17Updated 10 months ago
- BharatMLStack is an open-source, end-to-end machine learning infrastructure stack built at Meesho to support real-time and batch ML workl…☆612Updated last week