NiuTrans / ForgettingCurve
A benchmark for testing memorization abilities of LMs
☆20Updated 6 months ago
Alternatives and similar repositories for ForgettingCurve:
Users that are interested in ForgettingCurve are comparing it to the libraries listed below
- Codebase for Instruction Following without Instruction Tuning☆34Updated 7 months ago
- Long Context Extension and Generalization in LLMs☆53Updated 7 months ago
- HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models☆40Updated 4 months ago
- ☆76Updated 3 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated last month
- Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More☆28Updated 2 months ago
- Exploration of automated dataset selection approaches at large scales.☆39Updated last month
- Code for this paper "HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts via HyperNetwork"☆31Updated last year
- FastCuRL: Curriculum Reinforcement Learning with Progressive Context Extension for Efficient Training R1-like Reasoning Models☆42Updated last week
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆36Updated 11 months ago
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆53Updated last year
- Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆86Updated last month
- The official implementation of Cross-Task Experience Sharing (COPS)☆22Updated 6 months ago
- ☆37Updated 6 months ago
- ☆22Updated last week
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆44Updated this week
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆34Updated last month
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆74Updated 10 months ago
- Official Repository of Are Your LLMs Capable of Stable Reasoning?☆25Updated last month
- Code for Blog Post: Can Better Cold-Start Strategies Improve RL Training for LLMs?☆16Updated last month
- ☆17Updated 3 months ago
- ☆22Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated 11 months ago
- The paper list of multilingual pre-trained models (Continual Updated).☆20Updated 10 months ago
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆24Updated 2 months ago
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆20Updated last month
- [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study☆49Updated 5 months ago
- The official implementation of Preference Data Reward-Augmentation.☆17Updated 6 months ago
- A scalable automated alignment method for large language models. Resources for "Aligning Large Language Models via Self-Steering Optimiza…☆16Updated 5 months ago