Alternatives and similar repositories for pathpiece:

Users that are interested in pathpiece are comparing it to the libraries listed below

• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆18Updated last month
• cisnlp / ofa
  A Framework aims to wisely initialize unseen subword embeddings in PLMs for efficient large-scale continued pretraining
  ☆16Updated last year
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• allenai / bff
  ☆38Updated 11 months ago
• gonglinyuan / metro_t0
  Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)
  ☆22Updated last year
• ahmetustun / hyperx
  ☆20Updated 2 years ago
• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆31Updated 9 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆20Updated 7 months ago
• emorynlp / seq2seq-corenlp
  ☆13Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated 2 years ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• aviaefrat / lmentry
  ☆11Updated last year
• gautierdag / tokenizer-bench
  Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"
  ☆16Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆42Updated 8 months ago
• prometheus-eval / scaling-evaluation-compute
  Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"
  ☆11Updated this week
• csarron / BTR
  ☆15Updated last year
• orevaahia / magnet-tokenization
  ☆11Updated 3 months ago
• kaistAI / factual-knowledge-acquisition
  ☆17Updated 5 months ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• lucy3 / whos_filtered
  ☆14Updated 5 months ago
• da03 / criticize_text_generation
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Updated 2 years ago
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆43Updated 7 months ago
• swarnaHub / SummarizationPrograms
  [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees
  ☆24Updated last year
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆34Updated 3 months ago
• RUCAIBox / BAMBOO
  ☆34Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆24Updated last year
• amazon-science / tofueval
  ☆29Updated 10 months ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆47Updated last year
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago