sanyalsunny111 / LLM-Inheritune
This is the official repository for Inheritune.
☆111Updated last month
Alternatives and similar repositories for LLM-Inheritune:
Users that are interested in LLM-Inheritune are comparing it to the libraries listed below
- ☆76Updated 2 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆141Updated 6 months ago
- A repository for research on medium sized language models.☆76Updated 10 months ago
- ☆74Updated 7 months ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆148Updated 2 months ago
- Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)☆205Updated 10 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆161Updated 3 months ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆75Updated last year
- ☆96Updated 9 months ago
- ☆119Updated 6 months ago
- Code for Zero-Shot Tokenizer Transfer☆125Updated 2 months ago
- ☆125Updated last year
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆150Updated 3 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"☆131Updated last month
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆110Updated 10 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆116Updated 9 months ago
- ☆111Updated last month
- EvaByte: Efficient Byte-level Language Models at Scale☆85Updated last week
- ☆123Updated 4 months ago
- My fork os allen AI's OLMo for educational purposes.☆30Updated 3 months ago
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆55Updated 11 months ago
- This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.☆52Updated 7 months ago
- ☆41Updated 3 weeks ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆168Updated 2 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆44Updated last month
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆95Updated 2 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆219Updated 4 months ago
- Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"☆53Updated 6 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆117Updated last year
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆131Updated 4 months ago