ShinoharaHare / LLM-TrainingLinks
A distributed training framework for large language models powered by Lightning.
☆24Updated 4 months ago
Alternatives and similar repositories for LLM-Training
Users that are interested in LLM-Training are comparing it to the libraries listed below
Sorting:
- A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenizat…☆100Updated 3 months ago
- Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …☆57Updated last year
- Generative Fusion Decoding (GFD) is a novel framework for integrating Large Language Models (LLMs) into multi-modal text recognition syst…☆86Updated 4 months ago
- [Kaggle-2nd] Lightweight yet Effective Chinese LLM.☆52Updated 6 months ago
- Code for paper "Patch-Level Training for Large Language Models"☆95Updated last month
- ☆50Updated this week
- [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia☆173Updated last year
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆53Updated 9 months ago
- Evaluate your agent memory on real-world dialogues, not LLM-simulated dialogues.☆35Updated 5 months ago
- ☆19Updated last year
- Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…☆29Updated last year
- Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind☆108Updated last year
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆162Updated 8 months ago
- Training code for Baby-Llama, our submission to the strict-small track of the BabyLM challenge.☆84Updated 2 years ago
- This repo is an exploratory experiment to enable frozen pretrained RWKV language models to accept speech modality input. We followed the …☆54Updated 11 months ago
- ☆15Updated 2 years ago
- ☆75Updated 6 months ago
- Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…☆89Updated last month
- Leaderboard and code for "Speech-IFEval", Interspeech 2025☆23Updated 6 months ago
- just collections about Llama2☆44Updated last year
- finetune llama2 with traditional chinese dataset☆39Updated 2 years ago
- Evaluation code for benchmarking VLMs in traditional chinese understanding☆13Updated 3 weeks ago
- Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆48Updated 5 months ago
- SiLLM is a Simultaneous Machine Translation (SiMT) Framework. It utilizes a Large Language model as the translation model and employs a t…☆17Updated last year
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper☆152Updated last year
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆60Updated 3 months ago
- Python script for manipulating the existing tokenizer.☆20Updated 6 months ago
- Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)☆64Updated last year
- The official implementation of the paper "Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models" (NeurIPS 2025 Pos…☆47Updated 2 months ago
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆176Updated last year