facebookresearch / distributed-faiss

Related projects ⓘ

Alternatives and complementary repositories for distributed-faiss

• criteo / autofaiss
  Automatically create Faiss knn indices with the most optimal similarity search parameters.
  ☆812Updated 5 months ago
• matsui528 / faiss_tips
  Some useful tips for faiss
  ☆592Updated last year
• jina-ai / annlite
  ⚡ A fast embedded library for approximate nearest neighbor search
  ☆217Updated last year
• project-miracl / miracl
  A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
  ☆167Updated 3 months ago
• harsha-simhadri / big-ann-benchmarks
  Framework for evaluating ANNS algorithms on billion scale datasets.
  ☆352Updated last week
• triton-inference-server / fastertransformer_backend
  ☆411Updated 11 months ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆305Updated last year
• luyug / GradCache
  Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint
  ☆359Updated 7 months ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆270Updated last year
• luyug / Reranker
  Build Text Rerankers with Deep Language Models
  ☆251Updated 8 months ago
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆177Updated 8 months ago
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆205Updated last year
• RyanLiGod / hnsw-python
  hnsw implemented by python
  ☆62Updated 5 years ago
• facebookresearch / atlas
  Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03…
  ☆514Updated 11 months ago
• facebookresearch / SEAL
  Search Engines with Autoregressive Language models
  ☆277Updated last year
• NVIDIA-Merlin / systems
  Merlin Systems provides tools for combining recommendation models with other elements of production recommender systems (like feature sto…
  ☆90Updated 4 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆227Updated 7 months ago
• js1010 / cuhnsw
  CUDA implementation of Hierarchical Navigable Small World Graph algorithm
  ☆140Updated 3 years ago
• microsoft / MS-MARCO-Web-Search
  A large-scale information-rich web dataset, featuring millions of real clicked query-document labels
  ☆308Updated 5 months ago
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆206Updated 9 months ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆111Updated last year
• WPJiang / HWTL_SDU-ANNS
  ☆58Updated last year
• rapidsai / cuvs
  cuVS - a library for vector search and clustering on the GPU
  ☆210Updated this week
• studio-ousia / bpr
  Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering
  ☆168Updated 3 years ago
• google / seqio
  Task-based datasets, preprocessing, and evaluation for sequence models.
  ☆558Updated this week
• texttron / tevatron
  Tevatron - A flexible toolkit for neural retrieval research and development.
  ☆517Updated 2 weeks ago
• facebookresearch / SemDeDup
  Code for "SemDeDup", a simple method for identifying and removing semantic duplicates from a dataset (data pairs which are semantically s…
  ☆112Updated last year
• huggingface / transformers-bloom-inference
  Fast Inference Solutions for BLOOM
  ☆560Updated last month
• staoxiao / RetroMAE
  Codebase for RetroMAE and beyond.
  ☆237Updated 5 months ago
• bytedance / effective_transformer
  Running BERT without Padding
  ☆460Updated 2 years ago