DAMO-NLP-SG / CLEX

Related projects ⓘ

Alternatives and complementary repositories for CLEX

• yegcjs / mixinglaws
  ☆89Updated last month
• sail-sg / regmix
  🧬 RegMix: Data Mixture as Regression for Language Model Pre-training
  ☆87Updated last month
• yyDing1 / ScaleQuest
  We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆43Updated last week
• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆141Updated 4 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆142Updated 4 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆123Updated 2 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆111Updated last week
• lqtrung1998 / mwp_ReFT
  ☆98Updated 5 months ago
• TsinghuaC3I / Intuitive-Fine-Tuning
  Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process
  ☆22Updated 3 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆67Updated 5 months ago
• songmzhang / DSKD
  Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models".
  ☆36Updated this week
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆56Updated 8 months ago
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆67Updated 3 months ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆46Updated 3 months ago
• yuleiqin / fantastic-data-engineering
  Fantastic Data Engineering for Large Language Models
  ☆49Updated 3 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆28Updated 2 months ago
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆84Updated last year
• FreedomIntelligence / OVM
  ☆51Updated 7 months ago
• QwenLM / online_merging_optimizers
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆66Updated 4 months ago
• HKUNLP / STRING
  Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆59Updated this week
• SparkJiao / llama-pipeline-parallel
  A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to…
  ☆48Updated last year
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆84Updated 3 months ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆38Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆36Updated 8 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆67Updated last month
• MozerWang / Loong
  [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
  ☆89Updated last month
• pldlgb / nuggets
  ☆70Updated 10 months ago
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆45Updated last week
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆54Updated last month
• Junjie-Ye / ToolEyes
  ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆62Updated 6 months ago