Alternatives and similar repositories for ChapterBreak

Users that are interested in ChapterBreak are comparing it to the libraries listed below

• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆23Updated last year
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆39Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆54Updated 4 years ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆25Updated 3 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated 2 years ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆78Updated 2 years ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 3 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆55Updated last year
• kaistAI / factual-knowledge-acquisition
  ☆24Updated last month
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆20Updated 3 years ago
• SimengSun / alpaca_farm_lora
  ☆22Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 3 years ago
• sylinrl / CalibratedMath
  Teaching Models to Express Their Uncertainty in Words
  ☆39Updated 3 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆99Updated 4 years ago
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆34Updated 7 months ago
• ndaheim / faithful-dialogue
  ☆23Updated 2 years ago
• qkaren / COLD_decoding
  ☆114Updated 3 years ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆71Updated 2 years ago
• da03 / criticize_text_generation
  A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …
  ☆11Updated 2 years ago
• jxhe / efficient-knnlm
  Pytorch implementation of paper "Efficient Nearest Neighbor Language Models" (EMNLP 2021)
  ☆75Updated 4 years ago
• allenai / hyperdecoders
  Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304
  ☆14Updated 3 years ago
• ghrua / NgramRes
  ☆22Updated 3 years ago
• McGill-NLP / retriever-lm-reasoning
  Code for "Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model", EMNLP Findings 20…
  ☆28Updated 2 years ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆48Updated 2 years ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆67Updated 3 years ago
• jzbjyb / lm-calibration
  ☆35Updated 4 years ago