TemporaryLoRA / Temp-LoRA
☆89Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for Temp-LoRA
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆142Updated 4 months ago
- ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models☆166Updated last month
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆72Updated 7 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆216Updated 6 months ago
- ☆89Updated last month
- ☆48Updated 8 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆123Updated 2 months ago
- ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆62Updated 6 months ago
- code for Scaling Laws of RoPE-based Extrapolation☆70Updated last year
- 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training☆87Updated last month
- [SIGIR'24] The official implementation code of MOELoRA.☆123Updated 3 months ago
- Reformatted Alignment☆112Updated last month
- ☆70Updated 10 months ago
- [NeurIPS 2024 Oral] Aligner: Efficient Alignment by Learning to Correct☆111Updated last week
- Fantastic Data Engineering for Large Language Models☆49Updated 3 months ago
- Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process☆22Updated 3 months ago
- ☆37Updated 4 months ago
- Feeling confused about super alignment? Here is a reading list☆43Updated 10 months ago
- Counting-Stars (★)☆76Updated 2 months ago
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆141Updated 4 months ago
- Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"☆190Updated 3 weeks ago
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆131Updated 4 months ago
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆116Updated 4 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆67Updated 5 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆43Updated last week
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆38Updated 8 months ago
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆30Updated last year
- The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…☆32Updated 3 months ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆52Updated 6 months ago
- ☆129Updated 4 months ago