Alternatives and similar repositories for distributed-faiss

Users that are interested in distributed-faiss are comparing it to the libraries listed below

• matsui528 / faiss_tips
  Some useful tips for faiss
  ☆628Updated 2 months ago
• criteo / autofaiss
  Automatically create Faiss knn indices with the most optimal similarity search parameters.
  ☆880Updated 3 weeks ago
• jina-ai / annlite
  ⚡ A fast embedded library for approximate nearest neighbor search
  ☆234Updated 2 years ago
• RyanLiGod / hnsw-python
  hnsw implemented by python
  ☆71Updated 6 years ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆298Updated 5 months ago
• microsoft / MS-MARCO-Web-Search
  A large-scale information-rich web dataset, featuring millions of real clicked query-document labels
  ☆345Updated 11 months ago
• triton-inference-server / fastertransformer_backend
  ☆413Updated 2 years ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆316Updated 2 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆113Updated 2 years ago
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆198Updated 5 months ago
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆65Updated 2 years ago
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆433Updated 3 years ago
• luyug / GradCache
  Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
  ☆418Updated last year
• js1010 / cuhnsw
  CUDA implementation of Hierarchical Navigable Small World Graph algorithm
  ☆170Updated 4 years ago
• hpcaitech / PaLM-colossalai
  Scalable PaLM implementation of PyTorch
  ☆189Updated 2 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆157Updated last year
• project-miracl / miracl
  A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
  ☆197Updated last year
• RAIVNLab / MRL
  Code repository for the paper - "Matryoshka Representation Learning"
  ☆582Updated last year
• microsoft / varuna
  ☆252Updated last year
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆178Updated 2 years ago
• facebookresearch / SEAL
  Search Engines with Autoregressive Language models
  ☆293Updated 2 years ago
• harsha-simhadri / big-ann-benchmarks
  Framework for evaluating ANNS algorithms on billion scale datasets.
  ☆411Updated last week
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆175Updated 3 weeks ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆154Updated last year
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆210Updated 2 years ago
• HuaizhengZhang / Active-Learning-as-a-Service
  A scalable & efficient active learning/data selection system for everyone.
  ☆217Updated last year
• studio-ousia / bpr
  Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering
  ☆174Updated 4 years ago
• google / seqio
  Task-based datasets, preprocessing, and evaluation for sequence models.
  ☆589Updated last week
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆165Updated last week
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆277Updated 3 years ago