ShinoharaHare / LLM-Training
A distributed training framework for large language models powered by Lightning.
☆18Updated last month
Alternatives and similar repositories for LLM-Training:
Users that are interested in LLM-Training are comparing it to the libraries listed below
- a lightweight-yet-effective Chinese LLM.☆17Updated last month
- Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …☆43Updated 8 months ago
- Generative Fusion Decoding (GFD) is a novel framework for integrating Large Language Models (LLMs) into multi-modal text recognition syst…☆76Updated 5 months ago
- A Traditional-Chinese instruction-following model with datasets based on Alpaca.☆136Updated last year
- finetune llama2 with traditional chinese dataset☆38Updated last year
- Official github repo for TMMLU+, Large scale traditional chinese massive multitask language understanding☆45Updated 6 months ago
- 台灣閩南語大型語言模型 (Taiwanese Hokkien LLMs)☆30Updated 6 months ago
- 聯發創新基地(MediaTek Research) 致力於研究基礎模型。我們將研究體現在適合繁體中文使用者的模型上,並在使用權許可的情況下,提供模型給學術界研究或產業界使用。☆210Updated this week
- 使用繁體中文資料集做的 Embedding 模型評測☆40Updated 7 months ago
- just collections about Llama2☆44Updated 5 months ago
- ☆14Updated 3 years ago
- ☆60Updated 7 months ago
- [ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia☆158Updated 6 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆160Updated 2 months ago
- Arrange methods and example on finetune LLMs☆70Updated 7 months ago
- ☆12Updated last year
- Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback☆92Updated last year
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆77Updated 4 months ago
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper☆125Updated 7 months ago
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆89Updated last year
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision☆84Updated 3 months ago
- Training code for Baby-Llama, our submission to the strict-small track of the BabyLM challenge.☆77Updated last year
- Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation☆33Updated 11 months ago
- Prune transformer layers☆67Updated 8 months ago
- ☆40Updated 9 months ago
- A publishing website of a table collecting meta-learning-related papers in the area of human language processing.☆17Updated 3 years ago
- ☆20Updated 2 years ago
- ☆29Updated 2 months ago
- Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)☆184Updated 5 months ago
- ☆84Updated 2 months ago