Alternatives and similar repositories for distributed-faiss

Users that are interested in distributed-faiss are comparing it to the libraries listed below

• criteo / autofaiss
  Automatically create Faiss knn indices with the most optimal similarity search parameters.
  ☆859Updated last year
• jina-ai / annlite
  ⚡ A fast embedded library for approximate nearest neighbor search
  ☆230Updated last year
• matsui528 / faiss_tips
  Some useful tips for faiss
  ☆622Updated last year
• microsoft / MS-MARCO-Web-Search
  A large-scale information-rich web dataset, featuring millions of real clicked query-document labels
  ☆331Updated 6 months ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆298Updated 2 weeks ago
• js1010 / cuhnsw
  CUDA implementation of Hierarchical Navigable Small World Graph algorithm
  ☆159Updated 4 years ago
• triton-inference-server / fastertransformer_backend
  ☆411Updated last year
• bytedance / effective_transformer
  Running BERT without Padding
  ☆471Updated 3 years ago
• luyug / Reranker
  Build Text Rerankers with Deep Language Models
  ☆263Updated last year
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆313Updated 2 years ago
• harsha-simhadri / big-ann-benchmarks
  Framework for evaluating ANNS algorithms on billion scale datasets.
  ☆379Updated last month
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆251Updated last year
• luyug / GradCache
  Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
  ☆395Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆564Updated 8 months ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆153Updated last week
• google / seqio
  Task-based datasets, preprocessing, and evaluation for sequence models.
  ☆582Updated last month
• facebookresearch / SEAL
  Search Engines with Autoregressive Language models
  ☆288Updated 2 years ago
• milvus-io / knowhere
  Knowhere is an open-source vector search engine, integrating FAISS, HNSW, etc.
  ☆211Updated last year
• matsui528 / nanopq
  Pure python implementation of product quantization for nearest neighbor search
  ☆345Updated 2 weeks ago
• RAIVNLab / MRL
  Code repository for the paper - "Matryoshka Representation Learning"
  ☆507Updated last year
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆208Updated last year
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆64Updated last year
• facebookresearch / atlas
  Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03…
  ☆539Updated last year
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆191Updated 10 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆119Updated last year
• facebookresearch / SemDeDup
  Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically s…
  ☆136Updated last year
• staoxiao / RetroMAE
  Codebase for RetroMAE and beyond.
  ☆263Updated last year
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆178Updated last year
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆433Updated 2 years ago
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆169Updated last year