nlp-greyfoss / metagrad
一个用于学习的仿Pytorch纯Python实现的自动求导工具。
☆51Updated last year
Alternatives and similar repositories for metagrad
Users that are interested in metagrad are comparing it to the libraries listed below
Sorting:
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆154Updated 7 months ago
- Inference code for LLaMA models☆120Updated last year
- 使用单个24G显卡，从0开始训练LLM☆53Updated this week
- DeepSpeed Tutorial☆97Updated 9 months ago
- ☆70Updated 2 months ago
- DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）☆162Updated last year
- personal chatgpt☆363Updated 5 months ago
- pytorch分布式训练☆65Updated last year
- 对llama3进行全参微调、lora微调以及qlora微调。☆195Updated 7 months ago
- 怎么训练一个LLM分词器☆144Updated last year
- 一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。☆217Updated last year
- NumPy实现类PyTorch的动态计算图和神经网络框架(MLP, CNN, RNN, Transformer)☆81Updated 10 months ago
- ☆35Updated last year
- llama，chatglm 等模型的微调☆88Updated 9 months ago
- Hugging Face Transformers Course 笔记☆40Updated 3 years ago
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆321Updated 9 months ago
- 大模型基础学习和面试八股文☆117Updated last year
- ☆73Updated 7 months ago
- 一些 LLM 方面的从零复现笔记☆192Updated 2 weeks ago
- Implementation of FlashAttention in PyTorch☆146Updated 4 months ago
- 用Numpy复现可训练的LLaMa3☆34Updated 10 months ago
- ☆18Updated 3 years ago
- ☆33Updated 4 months ago
- ☆81Updated 3 weeks ago
- ☆108Updated 6 months ago
- ☆52Updated last year
- LLM101n: Let's build a Storyteller 中文版☆132Updated 9 months ago
- pytorch distribute tutorials☆131Updated this week
- everything about llm & aigc☆61Updated 3 weeks ago
- ☆79Updated last year