sanyalsunny111 / LLM-Inheritune
This is the official repository for Inheritune.
☆111Updated 2 months ago
Alternatives and similar repositories for LLM-Inheritune:
Users that are interested in LLM-Inheritune are comparing it to the libraries listed below
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆76Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆142Updated 7 months ago
- ☆126Updated 5 months ago
- Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"☆120Updated 8 months ago
- ☆96Updated 9 months ago
- ☆76Updated 3 months ago
- ☆114Updated 2 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆133Updated 5 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆164Updated 3 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆87Updated last month
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆137Updated 2 months ago
- [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study☆49Updated 5 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆220Updated 5 months ago
- Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"☆53Updated 6 months ago
- ☆57Updated last month
- Code for Zero-Shot Tokenizer Transfer☆127Updated 3 months ago
- Small and Efficient Mathematical Reasoning LLMs☆71Updated last year
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆148Updated 2 weeks ago
- ☆77Updated 8 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆120Updated last year
- ☆120Updated 6 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆47Updated last month
- My fork os allen AI's OLMo for educational purposes.☆30Updated 4 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆171Updated 3 months ago
- ☆47Updated 7 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆74Updated 10 months ago
- A repository for research on medium sized language models.☆76Updated 11 months ago
- Replicating O1 inference-time scaling laws☆83Updated 4 months ago
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆57Updated last year
- ☆145Updated last year