Alternatives and similar repositories for dedupe_estimator

Users that are interested in dedupe_estimator are comparing it to the libraries listed below

• xetdata / xet-core
  Rust crates for XetHub
  ☆76Updated last year
• aeturrell / smartrappy
  Smart reproducible analytical pipeline inspection
  ☆21Updated 3 weeks ago
• dwarvesf / llm-hosting
  This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…
  ☆26Updated 10 months ago
• huggingface / candle-cublaslt
  ☆12Updated last year
• datasette / datasette-enrichments-gpt
  Datasette enrichment for analyzing row data using OpenAI's GPT models
  ☆21Updated last year
• jbellis / colbert-live
  ColBERT for live vector indexes
  ☆28Updated last year
• lance-format / lance-context
  Manage Multimodal Agentic Context Lifecycle with Lance
  ☆40Updated this week
• Query-farm / radio
  Radio is a DuckDB extension by Query.Farm that brings real-time event streams into your SQL workflows. It enables DuckDB to receive and s…
  ☆35Updated last month
• lucyknada / detective-needle-llm
  ☆12Updated last year
• xetdata / pyxet
  Python SDK for XetHub
  ☆60Updated last year
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated 7 months ago
• liamca / sqlite-hybrid-search
  Hybrid Search (BM25 & Vector) with SQLite
  ☆27Updated last year
• simonw / scrape-fediverse
  Git scrapers for scraping the fediverse
  ☆19Updated this week
• eeroel / hae
  Like grep but with natural language queries
  ☆50Updated 2 years ago
• Supahands / llm-comparison
  This is an opensource project allowing you to compare two LLM's head to head with a given prompt, it has a wide range of supported models…
  ☆25Updated 10 months ago
• mozilla-ai / lm-buddy
  Your buddy in the (L)LM space.
  ☆64Updated last year
• hyehudai / wireduck
  Duckdb extension to read pcap files
  ☆47Updated 4 months ago
• rmit-ir / walert
  Code and data for the Walert large language model-based chatbot
  ☆12Updated 5 months ago
• machinelearningZH / hybrid-search-eval
  A framework for benchmarking embedding models in hybrid search scenarios (BM25 + vector search) using Weaviate.
  ☆37Updated 2 weeks ago
• tdoehmen / gitschemas
  ☆11Updated 2 years ago
• maxdotio / neural-solr
  Neural Solr = Solr 9 + Mighty Inference + Node
  ☆18Updated 3 years ago
• rabilrbl / llamafile-builder
  A simple github actions script to build a llamafile and uploads to huggingface
  ☆17Updated 2 years ago
• puppygraph / puppygraph-query
  PuppyGraph standalone web server for visualize graph queries.
  ☆46Updated 11 months ago
• allenai / duplodocus
  Tooling for exact and MinHash deduplication of large-scale text datasets
  ☆60Updated 2 weeks ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated 2 years ago
• gptscript-ai / function-calling-test-suite
  ☆12Updated last year
• Florents-Tselai / tsellm
  tsellm: LLMs in SQLite and DuckDB
  ☆25Updated 9 months ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆65Updated 2 years ago
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆63Updated 4 months ago
• tabsdata / tabsdata
  A Pub/Sub for Tables based data integration platform, to discover, publish, modify and consume data effortlessly.
  ☆38Updated last month