RUCAIBox / LLMSurvey
The official GitHub page for the survey paper "A Survey of Large Language Models".
☆10,460Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for LLMSurvey
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆16,471Updated this week
- A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)☆9,499Updated 5 months ago
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"☆10,776Updated 3 months ago
- Latest Advances on Multimodal Large Language Models☆12,722Updated this week
- The paper list of the 86-page paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.☆6,852Updated 3 months ago
- Fast and memory-efficient exact attention☆14,279Updated this week
- An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.☆8,276Updated this week
- Awesome-LLM: a curated list of Large Language Model☆18,908Updated 2 weeks ago
- 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)☆18,407Updated 6 months ago
- BELLE: Be Everyone's Large Language model Engine(开源中文对话大模型)☆7,929Updated last month
- Instruction Tuning with GPT-4☆4,210Updated last year
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆20,194Updated last week
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,760Updated 8 months ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆9,943Updated this week
- Aligning pretrained language models with instruction data generated by themselves.☆4,164Updated last year
- 整理开源的中文 大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。☆16,047Updated 2 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,059Updated 5 months ago
- 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)☆10,810Updated 2 weeks ago
- Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、…☆5,865Updated 3 weeks ago
- 中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)☆7,106Updated last month
- A large-scale 7B pretraining language model developed by BaiChuan-Inc.☆5,675Updated 4 months ago
- Retrieval and Retrieval-augmented LLMs☆7,613Updated this week
- ☆2,595Updated last week
- Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom dataset…☆15,222Updated this week
- Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)☆34,589Updated this week
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆29,561Updated 4 months ago
- Train transformer language models with reinforcement learning.☆10,086Updated this week
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆20,286Updated 3 months ago
- Instruct-tune LLaMA on consumer hardware☆18,653Updated 3 months ago
- A series of large language models trained from scratch by developers @01-ai☆7,711Updated last week