WENGSYX / LMTunerLinks
LMTuner: Make the LLM Better for Everyone
☆37Updated 2 years ago
Alternatives and similar repositories for LMTuner
Users that are interested in LMTuner are comparing it to the libraries listed below
Sorting:
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆40Updated last year
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆81Updated last year
- FuseAI Project☆87Updated 11 months ago
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated 2 years ago
- Reformatted Alignment☆113Updated last year
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆63Updated last year
- Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"☆102Updated last year
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆31Updated last year
- CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)☆73Updated last year
- Open Implementations of LLM Analyses☆108Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)☆147Updated last year
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- This is the official repository for Inheritune.☆117Updated 10 months ago
- Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)☆63Updated last year
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆108Updated 9 months ago
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆26Updated 10 months ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Updated last year
- Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)☆27Updated 2 months ago
- A repository for research on medium sized language models.☆77Updated last year
- ☆48Updated last year
- ☆94Updated last year
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆141Updated 2 years ago
- Data preparation code for Amber 7B LLM☆94Updated last year
- ☆55Updated last year
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆126Updated 11 months ago
- LongEmbed: Extending Embedding Models for Long Context Retrieval (EMNLP 2024)☆145Updated last year
- ☆71Updated last year
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆58Updated 3 weeks ago
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆62Updated last year