bigai-nlco / CREAM
[NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding
☆15Updated 4 months ago
Alternatives and similar repositories for CREAM:
Users that are interested in CREAM are comparing it to the libraries listed below
- RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment☆14Updated 2 months ago
- Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)☆22Updated 3 months ago
- Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)☆22Updated 6 months ago
- The code and data for the paper JiuZhang3.0☆40Updated 9 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆44Updated 2 months ago
- ☆20Updated 2 years ago
- ☆21Updated 2 months ago
- ☆58Updated 6 months ago
- ☆17Updated 3 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆72Updated 8 months ago
- Codebase for Instruction Following without Instruction Tuning☆33Updated 5 months ago
- Long Context Extension and Generalization in LLMs☆50Updated 5 months ago
- ☆14Updated last year
- M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆55Updated 2 months ago
- Offical code repository for PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation, EMNLP 2023☆12Updated last year
- This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"☆29Updated 7 months ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆35Updated 10 months ago
- ☆15Updated 7 months ago
- MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following☆15Updated 4 months ago
- Visual and Embodied Concepts evaluation benchmark☆21Updated last year
- [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style☆19Updated 2 weeks ago
- This the implementation of LeCo☆32Updated last month
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated 11 months ago
- ☆42Updated 4 months ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆41Updated 3 months ago
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆35Updated 9 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆60Updated 4 months ago
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆29Updated 10 months ago
- [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens☆22Updated last year