TemporaryLoRA / Temp-LoRA
☆101Updated last year
Alternatives and similar repositories for Temp-LoRA:
Users that are interested in Temp-LoRA are comparing it to the libraries listed below
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆153Updated 9 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆247Updated 3 months ago
- ☆98Updated 6 months ago
- ☆60Updated 4 months ago
- ☆45Updated 9 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆72Updated last year
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆179Updated 5 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆60Updated 5 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated last year
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆230Updated last month
- ☆171Updated last month
- A Comprehensive Survey on Long Context Language Modeling☆113Updated last week
- The official repository of the Omni-MATH benchmark.☆78Updated 3 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆147Updated 6 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆162Updated 9 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆171Updated 3 weeks ago
- On Memorization of Large Language Models in Logical Reasoning☆60Updated this week
- a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation☆45Updated 2 weeks ago
- Repository of LV-Eval Benchmark☆61Updated 7 months ago
- Reformatted Alignment☆115Updated 6 months ago
- ☆49Updated last year
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆252Updated 6 months ago
- ☆81Updated last year
- ☆101Updated 3 months ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆76Updated last month
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆121Updated 8 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆73Updated 9 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆216Updated last week
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆130Updated 6 months ago
- [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)☆117Updated last month