Alternatives and similar repositories for TxT360

Users that are interested in TxT360 are comparing it to the libraries listed below

• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 9 months ago
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆31Updated last year
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of RL Scaling
  ☆52Updated last month
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆62Updated 10 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆50Updated this week
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆35Updated 9 months ago
• qiuzh20 / gated_attention
  The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
  ☆40Updated 3 weeks ago
• ChengpengLi1003 / DotaMath
  ☆29Updated 5 months ago
• RUCAIBox / BAMBOO
  ☆35Updated last year
• swj0419 / in-context-pretraining
  ☆50Updated last year
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆39Updated last month
• PlusLabNLP / Active-IT
  Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"
  ☆24Updated last year
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆52Updated last month
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆16Updated last year
• ndaheim / faithful-dialogue
  ☆24Updated 2 years ago
• yiqingxyq / RepoST
  Code for "RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"
  ☆20Updated 2 months ago
• PrasannS / rlhf-length-biases
  ☆28Updated last year
• koalazf99 / nanoverl
  Collections of RLxLM experiments using minimal codes
  ☆13Updated 3 months ago
• sail-sg / symbolic-instruction-tuning
  The official repository for the paper "From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning".
  ☆65Updated 2 years ago
• Muennighoff / FLAN
  Provides a minimal implementation to extract FLAN datasets for further processing
  ☆11Updated 2 years ago
• yegcjs / mixinglaws
  ☆100Updated 8 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• KwanWaiChung / M4LE
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆23Updated 10 months ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated last year
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆22Updated 5 months ago
• anadim / the-little-retrieval-test
  ☆34Updated last year
• googleinterns / localizing-paragraph-memorization
  ☆14Updated last year
• FranxYao / Retrieval-Head-with-Flash-Attention
  Efficient retrieval head analysis with triton flash attention that supports topK probability
  ☆12Updated 11 months ago
• chijames / KERPLE
  ☆19Updated 2 years ago