Alternatives and similar repositories for peS2o

Users that are interested in peS2o are comparing it to the libraries listed below

• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆128Updated last year
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆150Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated 2 years ago
• google-research / t5x_retrieval
  ☆98Updated 2 years ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆212Updated last year
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆292Updated 3 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆201Updated 3 weeks ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆221Updated 6 months ago
• Mivg / SLED
  The official repository for Efficient Long-Text Understanding Using Short-Text Models (Ivgi et al., 2022) paper
  ☆69Updated 2 years ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆48Updated last year
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆81Updated last year
• hadasah / btm
  ☆72Updated last year
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆188Updated 9 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆89Updated 6 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆182Updated 5 months ago
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆91Updated last year
• shayne-longpre / a-pretrainers-guide
  ☆72Updated 2 years ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆162Updated last year
• allenai / bff
  ☆38Updated last year
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆198Updated last month
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 8 months ago
• jakespringer / echo-embeddings
  ☆149Updated last year
• DaoD / INTERS
  This is the repository for our paper "INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning"
  ☆203Updated 5 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆249Updated last year
• huggingface / olm-datasets
  Pipeline for pulling and processing online language model pretraining data from the web
  ☆178Updated last year
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆91Updated 3 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆142Updated 7 months ago
• huggingface / that_is_good_data
  ☆65Updated last year
• kernelmachine / cbtm
  Code repository for the c-BTM paper
  ☆106Updated last year