Alternatives and similar repositories for pathpiece

Users that are interested in pathpiece are comparing it to the libraries listed below

• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆32Updated 11 months ago
• PrasannS / rlhf-length-biases
  ☆28Updated last year
• ahmetustun / hyperx
  ☆20Updated 2 years ago
• cisnlp / ofa
  A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining
  ☆16Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 9 months ago
• HansiZeng / scaling-retriever
  [SIGIR 2025] The official repo for "Scaling Sparse and Dense Retrieval in Decoder-Only LLMs"
  ☆13Updated 2 months ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• allenai / bff
  ☆38Updated last year
• orevaahia / magnet-tokenization
  ☆12Updated 5 months ago
• lucy3 / whos_filtered
  ☆14Updated 8 months ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆20Updated 4 months ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆41Updated 2 years ago
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆18Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆48Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated last month
• gonglinyuan / metro_t0
  Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)
  ☆22Updated last year
• thakur-nandan / income
  INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.
  ☆24Updated last year
• kaistAI / factual-knowledge-acquisition
  ☆20Updated last month
• zhichaoxu-shufe / context-aware-decoding-qfs
  ☆12Updated last year
• liujch1998 / memo-trap
  ☆21Updated 2 years ago
• kaistAI / Janus
  [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages
  ☆47Updated 6 months ago
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆25Updated 6 months ago
• GAIR-NLP / benbench
  Benchmarking Benchmark Leakage in Large Language Models
  ☆51Updated last year
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆25Updated 4 months ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• prometheus-eval / scaling-evaluation-compute
  Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"
  ☆12Updated 2 months ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆57Updated 2 years ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆38Updated 2 years ago
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆44Updated 11 months ago