ShinoharaHare / LLM-Training
A distributed training framework for large language models powered by Lightning.
☆19Updated 2 weeks ago
Alternatives and similar repositories for LLM-Training:
Users that are interested in LLM-Training are comparing it to the libraries listed below
- finetune llama2 with traditional chinese dataset☆38Updated last year
- Generative Fusion Decoding (GFD) is a novel framework for integrating Large Language Models (LLMs) into multi-modal text recognition syst…☆78Updated 6 months ago
- Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …☆47Updated 10 months ago
- Lightweight and Effective Chinese LLM.☆22Updated last month
- A Traditional-Chinese instruction-following model with datasets based on Alpaca.☆136Updated 2 years ago
- just collections about Llama2☆44Updated 6 months ago
- 聯發創新基地(MediaTek Research) 致力於研究基礎模型。我們將研究體現在適合繁體中文使用者的模型上,並在使用權許可的情況下,提供模型給學術界研究或產業界使用。☆225Updated last month
- Arrange methods and example on finetune LLMs☆74Updated 8 months ago
- Official github repo for TMMLU+, Large scale traditional chinese massive multitask language understanding☆45Updated 8 months ago
- 使用繁體中文資料集做的 Embedding 模型評測☆45Updated 8 months ago
- Building, Extending & Customizing Foundation Models: FoxBrain Foundation Model --> Journey to Frontier AI (「建立、擴展與自訂基礎模型:FoxBrain基礎模型 → …☆38Updated 2 weeks ago
- This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.☆52Updated 7 months ago
- ☆14Updated last year
- 台灣閩南語大型語言模型 (Taiwanese Hokkien LLMs)☆33Updated 7 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆165Updated this week
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆80Updated 6 months ago
- ☆16Updated 2 months ago
- Function Calling Leaderboard for Traditional Chinese (zh-tw)☆29Updated 4 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆147Updated 6 months ago
- 探索 AI 的未來!聯發創新基地(MediaTek Research)首次開源的手機應用程式,讓你直接體驗我們最新研發的 AI 模型。透過手機,我們將 AI 科技帶入每個人的生活,完全離線運作,隱私更有保障。這是一個開源專案,我們熱烈歡迎開發者和愛好者一同參與,為 AI 技…☆84Updated this week
- ☆60Updated 8 months ago
- ☆107Updated last month
- Unofficial implementation of AlpaGasus☆90Updated last year
- Code for the AICUP2023 competition "Meet the truth: Fact Extraction and Verification for Disinformation".☆22Updated last year
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆53Updated this week
- Revolutionize your development workflow with AI-powered code assistance, automating mock tests, suggestions, and unit test generation in …☆34Updated last month
- ☆12Updated last year
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision☆87Updated 5 months ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆39Updated last month
- [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales☆80Updated last month