Alternatives and similar repositories for ia-web-commons:

Users that are interested in ia-web-commons are comparing it to the libraries listed below

• allenai / bff
  ☆38Updated last year
• google-research / t5x_retrieval
  ☆97Updated 2 years ago
• thongnt99 / learned-sparse-retrieval
  Unified Learned Sparse Retrieval Framework
  ☆64Updated 11 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆101Updated last year
• castorini / dhr
  Dense hybrid representations for text retrieval
  ☆62Updated 2 years ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆161Updated 6 months ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆104Updated last year
• sebastian-hofstaetter / colberter
  ☆45Updated 3 years ago
• studio-ousia / bpr
  Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering
  ☆170Updated 3 years ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆150Updated 11 months ago
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated last year
• r-three / common-pile
  Repo to hold code and track issues for the collection of permissively licensed data
  ☆23Updated 2 weeks ago
• lemurproject / ClueWeb22
  ☆16Updated 4 months ago
• terrierteam / ir_measures
  provides a common interface to many IR measure tools
  ☆84Updated last week
• unicamp-dl / ExaRanker
  ☆29Updated last year
• castorini / mr.tydi
  Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.
  ☆75Updated 3 years ago
• castorini / ragnarok
  Retrieval-Augmented Generation battle!
  ☆49Updated 4 months ago
• cambridgeltl / composable-sft
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆71Updated 8 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆218Updated 5 months ago
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆190Updated last year
• thakur-nandan / sprint
  SPRINT Toolkit helps you evaluate diverse neural sparse models easily using a single click on any IR dataset.
  ☆45Updated last year
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆177Updated last year
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆88Updated 2 months ago
• terrierteam / pyterrier_colbert
  ☆86Updated 3 weeks ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆292Updated 2 months ago
• unicamp-dl / mMARCO
  A multilingual version of MS MARCO passage ranking dataset
  ☆144Updated last year
• shayne-longpre / a-pretrainers-guide
  ☆72Updated last year