NormXU / Consistent-DynamicNTKRoPE

Related projects: ⓘ

• yegcjs / mixinglaws
  ☆87Updated 4 months ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆72Updated 6 months ago
• QwenLM / online_merging_optimizers
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆60Updated 3 months ago
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆101Updated last week
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆133Updated 3 months ago
• sail-sg / regmix
  🧬 RegMix: Data Mixture as Regression for Language Model Pre-training
  ☆79Updated this week
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆83Updated 11 months ago
• wxjiao / InstructMT
  A collection of instruction data and scripts for machine translation.
  ☆20Updated 11 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆27Updated 2 weeks ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆68Updated 11 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆34Updated 2 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆54Updated 6 months ago
• SparkJiao / llama-pipeline-parallel
  A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to…
  ☆45Updated last year
• FlagOpen / Infinity-Instruct
  ☆32Updated 3 months ago
• AI21Labs / Parallel-Context-Windows
  ☆99Updated last year
• shizhediao / Post-Training-Data-Flywheel
  We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.
  ☆38Updated 2 weeks ago
• fairyshine / Seal-Tools
  The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…
  ☆31Updated last month
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web"
  ☆106Updated this week
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆114Updated 2 months ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting
  ☆60Updated 6 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆72Updated 8 months ago
• fe1ixxu / CPO_SIMPO
  This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.
  ☆28Updated last month
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆38Updated last month
• yuleiqin / fantastic-data-engineering
  Fantastic Data Engineering for Large Language Models
  ☆38Updated last month
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆80Updated last year
• RUCAIBox / BAMBOO
  ☆31Updated 5 months ago
• Jxu-Thu / DITTO
  The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…
  ☆39Updated last year
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆106Updated this week
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆37Updated 6 months ago
• TsinghuaC3I / Intuitive-Fine-Tuning
  Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process
  ☆17Updated last month