Alternatives and similar repositories for LLM_KD_AKL:

Users that are interested in LLM_KD_AKL are comparing it to the libraries listed below

• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆36Updated last week
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆45Updated 3 months ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago
• RUCAIBox / ELMER
  This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…
  ☆26Updated 2 years ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆34Updated 6 months ago
• yale-nlp / refdpo
  ☆15Updated 8 months ago
• llyx97 / sparse-and-robust-PLM
  [NeurIPS 2022] "A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models", Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li…
  ☆21Updated last year
• yhao-wang / LLM-Knowledge-Boundary
  Implementation of "Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation"
  ☆22Updated last year
• ChengpengLi1003 / DotaMath
  ☆29Updated 3 months ago
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆20Updated 7 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 6 months ago
• zjunlp / TRICE
  [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback
  ☆41Updated last year
• RUCAIBox / QuantizedEmpirical
  ☆14Updated last year
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆43Updated 10 months ago
• DAMO-NLP-SG / TempReason
  ☆31Updated last year
• halfrot / ALaRM
  [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"
  ☆25Updated last year
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆40Updated 5 months ago
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆32Updated last year
• JungHoyoun / PromptCompressor
  ☆11Updated 11 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆22Updated 4 months ago
• feiyang-k / AutoScale
  Official Code Repository for [AutoScale–Automatic Prediction of Compute-optimal Data Compositions for Training LLMs]
  ☆12Updated last month
• yyDing1 / ScaleQuest
  We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆60Updated 5 months ago
• PKU-TANGENT / ConFiguRe
  Dataset and baseline for Coling 2022 long paper (oral): "ConFiguRe: Exploring Discourse-level Chinese Figures of Speech"
  ☆11Updated last year
• BeastyZ / LLM-Verified-Retrieval
  Repo for Llatrieval
  ☆29Updated 7 months ago
• vickywu1022 / OntoProbe-PLMs
  Repo for outstanding paper@ACL 2023 "Do PLMs Know and Understand Ontological Knowledge?"
  ☆31Updated last year
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆30Updated last year
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆44Updated this week
• xypan0 / G-DIG
  ☆11Updated 8 months ago