A minimalist but optimized Python package for deduplication tasks leveraging RapidFuzz internally, enabling super-fast approximate duplicate detection within a dataset with minimal config.
☆18Apr 2, 2025Updated last year
Alternatives and similar repositories for fast-dedupe
Users that are interested in fast-dedupe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- EmbedDB is an ultra-lightweight vector database designed for rapid prototyping of semantic search and RAG applications. The entire implem…☆21Mar 24, 2025Updated last year
- Goprox: Simplify Google searches with automatic proxy handling and user-agent selection.☆11Apr 12, 2024Updated 2 years ago
- ☆12May 19, 2024Updated 2 years ago
- Coinbean - Open Source Crypto Tracking☆11Jan 4, 2026Updated 10 months ago
- ☆11Dec 22, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Store collections of experimental data based on TileDB☆12Updated this week
- synthetic data for ml☆25Jan 30, 2025Updated last year
- A Python project that parses Markdown files into a tree structure, then processes them into semantically meaningful text chunks.☆22Jan 9, 2025Updated last year
- ☆11Nov 12, 2024Updated last year
- A local PII detection framework☆16Jun 3, 2026Updated 5 months ago
- ☆11Dec 22, 2022Updated 3 years ago
- Playing with Python Bluesky SDK☆15Nov 18, 2024Updated last year
- Example files used in the DuckDB - Unity Catalog blog☆10Dec 6, 2024Updated last year
- The tool to visualise architecture of python packages☆10Aug 16, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12Nov 19, 2022Updated 3 years ago
- Parameter-efficient fine-tuning of LLMs using QLoRA — 4-bit quantization, PEFT adapters, W&B experiment tracking☆14Oct 13, 2026Updated 3 weeks ago
- Iterate fast on your RAG pipelines☆24Jun 21, 2025Updated last year
- A python script to download batch mobile apps from Google Play Store☆10May 14, 2019Updated 7 years ago
- This repository contains code for the paper RMM: A Recursive Mental Model for Dialog Navigation☆10Nov 22, 2022Updated 3 years ago
- Put an AI agent on rails: mount a Burr state machine as an MCP server so the agent can only take the next allowed step, with every step r…☆16Updated this week
- Ever been told to RTFM only to find there is no FM to R? MCP-RTFM helps you CREATE the F*ing Manual that people keep telling everyone to …☆35Apr 20, 2026Updated 6 months ago
- Dataset of sentences from Hindi stories tagged with different emotion tags☆11Nov 26, 2019Updated 6 years ago
- ☆13Jul 17, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Common GitHub actions and workflows for maintaining dbt☆16Aug 27, 2026Updated 2 months ago
- Learn to build real world AI products☆13Jun 10, 2025Updated last year
- ☆17Aug 22, 2026Updated 2 months ago
- Long-term memory for AI agents with no LLM call: an MCP server and Claude Code plugin, plus local-first context compression for LLM apps.☆24Updated this week
- Notes on how to set up your backend instance☆11May 29, 2024Updated 2 years ago
- A company handbook with Fumadocs, local Markdown, optional Sanity editing and semantic search, and OpenAI chat.☆15Sep 12, 2026Updated last month
- ☆23Jan 13, 2025Updated last year
- System design for the AI era — LLM infra, RAG, agents, and the classic patterns updated for 2026☆13Mar 17, 2026Updated 7 months ago
- Midterms project for #mlzoomcamp 2023 cohort☆10Feb 23, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- R and Python solutions to applied exercises in An Introduction to Statistical Learning with Applications in R (corrected 7th printing)☆15Jun 4, 2025Updated last year
- Table detection with Florence.☆15Jul 11, 2024Updated 2 years ago
- How to connect your Hubspot CRM with Google Spreadsheet to generate an automated dashboard with Google Datastudio.☆26Feb 28, 2019Updated 7 years ago
- SQL-like query language and CLI for Qdrant vector search engine☆48Jun 13, 2026Updated 4 months ago
- This is the code for our ACL 2021 paper entitled eMLM: A New Pre-training Objective for Emotion Related Tasks☆15Sep 7, 2022Updated 4 years ago
- ☆12Dec 29, 2021Updated 4 years ago
- In this course you'll learn to use Gradio to create user-friendly apps with minimal code: Summarize text using a large language model, ge…☆15Nov 15, 2023Updated 2 years ago