ShinoharaHare / LLM-Training
A distributed training framework for large language models powered by Lightning.
☆21Updated 2 months ago
Alternatives and similar repositories for LLM-Training
Users that are interested in LLM-Training are comparing it to the libraries listed below
Sorting:
- Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …☆50Updated 11 months ago
- [Kaggle-2nd] Lightweight yet Effective Chinese LLM.☆50Updated 2 weeks ago
- Evaluation code for benchmarking VLMs in traditional chinese understanding☆12Updated 2 weeks ago
- Generative Fusion Decoding (GFD) is a novel framework for integrating Large Language Models (LLMs) into multi-modal text recognition syst…☆79Updated 8 months ago
- finetune llama2 with traditional chinese dataset☆38Updated last year
- A Traditional-Chinese instruction-following model with datasets based on Alpaca.☆137Updated 2 years ago
- just collections about Llama2☆44Updated 8 months ago
- ☆62Updated last month
- Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"☆86Updated 2 months ago
- ☆13Updated 5 months ago
- User-friendly implementation of the Mixture-of-Sparse-Attention (MoSA). MoSA selects distinct tokens for each head with expert choice rou…☆13Updated 2 weeks ago
- Official github repo for TMMLU+, Large scale traditional chinese massive multitask language understanding☆46Updated 9 months ago
- 聯發創新基地(MediaTek Research) 致力於研究基礎模型。我們將研究體現在適合繁體中文使用者的模型上,並在使用權許可的情況下,提供模型給學術界研究或產業界使用。☆233Updated 2 months ago
- Official Pytorch Implementation of Paper "DarwinLM: Evolutionary Structured Pruning of Large Language Models"☆11Updated 2 months ago
- Textless (ASR-transcript free) Spoken Question Answering. The official release of NMSQA dataset and the implementation of "DUAL: Textless…☆35Updated last year
- ☆62Updated 10 months ago
- 台灣閩南語大型語言模型 (Taiwanese Hokkien LLMs)☆36Updated 9 months ago
- Code for paper "Patch-Level Training for Large Language Models"☆84Updated 6 months ago
- ☆46Updated 3 weeks ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆84Updated 7 months ago
- one script for xls-r/xlsr/whisper fine-tuning☆41Updated last year
- 使用繁體中文資料集做的 Embedding 模型評測☆48Updated 10 months ago
- Taiwanese Speech Synthesis with Tacotron2☆19Updated 2 years ago
- The official repository of Quamba1 [ICLR 2025] & Quamba2 [ICML 2025]☆45Updated last month
- Toward Multi Modality Language Model - implementation of GPT-4o/Project Astra☆14Updated 5 months ago
- Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…☆32Updated last week
- Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding☆10Updated last year
- ☆17Updated 4 months ago
- ASR text preprocessing utility☆21Updated 9 months ago
- Implementation of Google's USM speech model in Pytorch☆31Updated last month