ShinoharaHare / LLM-TrainingLinks
A distributed training framework for large language models powered by Lightning.
☆22Updated 3 months ago
Alternatives and similar repositories for LLM-Training
Users that are interested in LLM-Training are comparing it to the libraries listed below
Sorting:
- [Kaggle-2nd] Lightweight yet Effective Chinese LLM.☆52Updated 5 months ago
- Generative Fusion Decoding (GFD) is a novel framework for integrating Large Language Models (LLMs) into multi-modal text recognition syst…☆86Updated 3 months ago
- Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …☆57Updated last year
- A method that directly addresses the modality gap by aligning speech token with the corresponding text transcription during the tokenizat…☆98Updated 2 months ago
- A Traditional-Chinese instruction-following model with datasets based on Alpaca.☆137Updated 2 years ago
- 台灣閩南語大型語言模 型 (Taiwanese Hokkien LLMs)☆52Updated last year
- Evaluate your agent memory on real-world dialogues, not LLM-simulated dialogues.☆35Updated 4 months ago
- finetune llama2 with traditional chinese dataset☆39Updated 2 years ago
- [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia☆173Updated last year
- Evaluation code for benchmarking VLMs in traditional chinese understanding☆13Updated 6 months ago
- (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …☆182Updated last year
- Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…☆86Updated last week
- Leaderboard and code for "Speech-IFEval", Interspeech 2025☆22Updated 5 months ago
- Code for paper "Patch-Level Training for Large Language Models"☆94Updated last week
- ☆70Updated 5 months ago
- ☆49Updated 3 months ago
- Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"☆115Updated 4 months ago
- ☆70Updated last month
- just collections about Llama2☆44Updated last year
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆269Updated 9 months ago
- ☆18Updated 11 months ago
- Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding☆11Updated 2 years ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆124Updated 11 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆180Updated last week
- Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)☆238Updated 8 months ago
- Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind☆106Updated last year
- Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆47Updated 4 months ago
- Training code for Baby-Llama, our submission to the strict-small track of the BabyLM challenge.☆84Updated 2 years ago
- Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…☆29Updated last year
- Official github repo for TMMLU+, Large scale traditional chinese massive multitask language understanding☆45Updated last year