sanyalsunny111 / LLM-Inheritune
This is the official repository for Inheritune.
☆109Updated 3 months ago
Alternatives and similar repositories for LLM-Inheritune:
Users that are interested in LLM-Inheritune are comparing it to the libraries listed below
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆76Updated last year
- ☆72Updated 2 weeks ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆139Updated 4 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆115Updated last year
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆107Updated 8 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆210Updated 2 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆128Updated 2 months ago
- FuseAI Project☆80Updated this week
- ☆125Updated last year
- ☆116Updated 3 months ago
- ☆70Updated 5 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆53Updated 5 months ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆147Updated last week
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆52Updated 9 months ago
- Code for Zero-Shot Tokenizer Transfer☆121Updated 2 weeks ago
- ☆17Updated 8 months ago
- A repository for research on medium sized language models.☆76Updated 8 months ago
- ☆138Updated 9 months ago
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- ☆98Updated last week
- Code and Data for "Long-context LLMs Struggle with Long In-context Learning"☆98Updated 6 months ago
- My fork os allen AI's OLMo for educational purposes.☆30Updated last month
- ☆143Updated last week
- 🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.☆101Updated this week
- Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"☆50Updated 3 months ago
- ☆80Updated 4 months ago
- This is the official repository of the paper "OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI"☆91Updated last month
- ☆94Updated 7 months ago