Alternatives and similar repositories for resonance_rope

Users that are interested in resonance_rope are comparing it to the libraries listed below

• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆39Updated last month
• liziniu / cold_start_rl
  Code for Blog Post: Can Better Cold-Start Strategies Improve RL Training for LLMs?
  ☆17Updated 3 months ago
• Zyphra / Zyda_processing
  ☆35Updated last year
• icip-cas / SSO
  A scalable automated alignment method for large language models. Resources for "Aligning Large Language Models via Self-Steering Optimiza…
  ☆18Updated 7 months ago
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆32Updated last year
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆78Updated last year
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆78Updated last year
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆58Updated last year
• Tomorrowdawn / top_nsigma
  The official code repo and data hub of top_nsigma sampling strategy for LLMs.
  ☆26Updated 4 months ago
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆37Updated 4 months ago
• Zheng0428 / COIG-Kun
  ☆36Updated 9 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 9 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• wxjiao / InstructMT
  A collection of instruction data and scripts for machine translation.
  ☆20Updated last year
• RenzeLou / Muffin
  MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following
  ☆16Updated 7 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆50Updated 3 weeks ago
• yale-nlp / refdpo
  ☆16Updated 11 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆73Updated last month
• yikangshen / megablocks
  ☆20Updated last year
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆23Updated 7 months ago
• hills-code / open-instruct
  ☆17Updated last year
• locuslab / scaling_laws_data_filtering
  ☆64Updated last year
• LLM360 / TxT360
  ☆18Updated 6 months ago
• qiuzh20 / gated_attention
  The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
  ☆44Updated last month
• open-compass / GPassK
  [ACL 2025] Are Your LLMs Capable of Stable Reasoning?
  ☆25Updated 3 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆55Updated this week
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆41Updated 7 months ago
• RUCAIBox / BAMBOO
  ☆35Updated last year