Alternatives and similar repositories for distributed-faiss:

Users that are interested in distributed-faiss are comparing it to the libraries listed below

• criteo / autofaiss
  Automatically create Faiss knn indices with the most optimal similarity search parameters.
  ☆841Updated 9 months ago
• jina-ai / annlite
  ⚡ A fast embedded library for approximate nearest neighbor search
  ☆226Updated last year
• matsui528 / faiss_tips
  Some useful tips for faiss
  ☆616Updated last year
• harsha-simhadri / big-ann-benchmarks
  Framework for evaluating ANNS algorithms on billion scale datasets.
  ☆366Updated 3 weeks ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆282Updated 2 weeks ago
• js1010 / cuhnsw
  CUDA implementation of Hierarchical Navigable Small World Graph algorithm
  ☆155Updated 3 years ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆308Updated last year
• luyug / Reranker
  Build Text Rerankers with Deep Language Models
  ☆260Updated last year
• microsoft / MS-MARCO-Web-Search
  A large-scale information-rich web dataset, featuring millions of real clicked query-document labels
  ☆316Updated 2 months ago
• luyug / GradCache
  Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
  ☆378Updated 11 months ago
• project-miracl / miracl
  A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
  ☆177Updated 7 months ago
• texttron / tevatron
  Tevatron - A flexible toolkit for neural retrieval research and development.
  ☆570Updated last week
• triton-inference-server / vllm_backend
  ☆235Updated this week
• allenai / ir_datasets
  Provides a common interface to many IR ranking datasets.
  ☆343Updated this week
• facebookresearch / SemDeDup
  Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically s…
  ☆130Updated last year
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆166Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆562Updated 5 months ago
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆188Updated last year
• RyanLiGod / hnsw-python
  hnsw implemented by python
  ☆65Updated 5 years ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆242Updated 11 months ago
• staoxiao / RetroMAE
  Codebase for RetroMAE and beyond.
  ☆253Updated 9 months ago
• rom1504 / cc2dataset
  Easily convert common crawl to a dataset of caption and document. Image/text Audio/text Video/text, ...
  ☆316Updated last year
• milvus-io / knowhere
  Knowhere is an open-source vector search engine, integrating FAISS, HNSW, etc.
  ☆209Updated last year
• facebookresearch / SEAL
  Search Engines with Autoregressive Language models
  ☆282Updated last year
• triton-inference-server / fastertransformer_backend
  ☆410Updated last year
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆63Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆208Updated last year
• TencentARC / BEBR
  Official code for "Binary embedding based retrieval at Tencent"
  ☆42Updated last year
• castorini / docTTTTTquery
  docTTTTTquery document expansion model
  ☆361Updated last year
• CosimoRulli / emvb
  Implementation of "Efficient Multi-vector Dense Retrieval with Bit Vectors", ECIR 2024
  ☆59Updated 5 months ago