allenai / bff

Related projects ⓘ

Alternatives and complementary repositories for bff

• shayne-longpre / a-pretrainers-guide
  ☆73Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆40Updated 4 months ago
• hadasah / btm
  ☆71Updated 6 months ago
• EleutherAI / semantic-memorization
  ☆46Updated this week
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆38Updated 3 weeks ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆44Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆58Updated 3 months ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆136Updated 3 weeks ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆18Updated 3 months ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated last year
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆73Updated last year
• anadim / the-little-retrieval-test
  ☆31Updated last year
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆68Updated 10 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆115Updated 3 weeks ago
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆105Updated last year
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆92Updated last year
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆80Updated 8 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆90Updated 8 months ago
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆30Updated 8 months ago
• google-research / t5x_retrieval
  ☆95Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated 7 months ago
• ruiqi-zhong / D5
  The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions
  ☆68Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated 10 months ago
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆141Updated 6 months ago
• swj0419 / in-context-pretraining
  ☆38Updated 7 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆122Updated 8 months ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆24Updated 2 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆78Updated 8 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆94Updated 7 months ago
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆57Updated 3 weeks ago