Alternatives and similar repositories for ChapterBreak

Users that are interested in ChapterBreak are comparing it to the libraries listed below

• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆23Updated last year
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆54Updated 4 years ago
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆39Updated 2 years ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 3 years ago
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆19Updated 3 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• swj0419 / in-context-pretraining
  ☆55Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆78Updated 2 years ago
• qkaren / COLD_decoding
  ☆113Updated 3 years ago
• SimengSun / alpaca_farm_lora
  ☆22Updated 2 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆25Updated 3 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated 2 years ago
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• jzbjyb / lm-calibration
  ☆35Updated 4 years ago
• allenai / hyperdecoders
  Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304
  ☆13Updated 3 years ago
• sylinrl / CalibratedMath
  Teaching Models to Express Their Uncertainty in Words
  ☆39Updated 3 years ago
• ndaheim / faithful-dialogue
  ☆24Updated 2 years ago
• GXimingLu / Quark
  ☆75Updated 2 years ago
• aviclu / ffn-values
  ☆68Updated 2 years ago
• rosewang2008 / language_modeling_via_stochastic_processes
  Language modeling via stochastic processes. Oral @ ICLR 2022.
  ☆138Updated 2 years ago
• lukemelas / mtob
  ☆43Updated last year
• Shark-NLP / CAB
  ☆31Updated 2 years ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆65Updated 2 years ago
• kaistAI / factual-knowledge-acquisition
  ☆23Updated 2 weeks ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆67Updated 3 years ago
• chaochun / nlu-asdiv-dataset
  ☆50Updated 2 years ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆69Updated 2 years ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆99Updated 4 years ago