Alternatives and similar repositories for MS-MARCO-Web-Search

Users that are interested in MS-MARCO-Web-Search are comparing it to the libraries listed below

• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆561Updated last week
• ContextualAI / gritlm
  Generative Representational Instruction Tuning
  ☆680Updated 6 months ago
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆207Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆225Updated last year
• huggingface / cosmopedia
  ☆559Updated last year
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆298Updated 6 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆278Updated last year
• naver / bergen
  Benchmarking library for RAG
  ☆249Updated 2 months ago
• project-miracl / miracl
  A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
  ☆197Updated last year
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆221Updated last week
• dwzhu-pku / LongEmbed
  LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)
  ☆145Updated last year
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆586Updated last year
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆189Updated 5 months ago
• freshllms / freshqa
  Data and code for FreshLLMs (https://arxiv.org/abs/2310.03214)
  ☆380Updated last month
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆199Updated 6 months ago
• texttron / tevatron
  Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.
  ☆712Updated last week
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆136Updated last year
• chentong0 / factoid-wiki
  Dense X Retrieval: What Retrieval Granularity Should We Use?
  ☆167Updated last year
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆677Updated last week
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆201Updated last year
• kamalkraj / e5-mistral-7b-instruct
  Finetune mistral-7b-instruct for sentence embeddings
  ☆88Updated last year
• AIR-Bench / AIR-Bench
  [ACL 2025] AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark
  ☆163Updated 2 months ago
• jakespringer / echo-embeddings
  ☆161Updated last year
• nomic-ai / contrastors
  Train Models Contrastively in Pytorch
  ☆765Updated 9 months ago
• sunnweiwei / RankGPT
  Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]
  ☆645Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆315Updated last month
• MadryLab / context-cite
  Attribute (or cite) statements generated by LLMs back to in-context information.
  ☆312Updated last year
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆155Updated last year
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆213Updated 3 months ago
• hltcoe / ColBERT-X
  CLIR version of ColBERT
  ☆74Updated 6 months ago