harleyszhang / llm_note
LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
☆755Updated this week
Alternatives and similar repositories for llm_note:
Users that are interested in llm_note are comparing it to the libraries listed below
- LLM全栈优质资源汇总☆541Updated 5 months ago
- 这是一个从头训练大语言模型的项目,包括预训练、微调和直接偏好优化,模型拥有1B参数,支持中英文。☆379Updated 2 months ago
- A self-learning tutorail for CUDA High Performance Programing.☆615Updated 3 weeks ago
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆707Updated 2 weeks ago
- My learning notes/codes for ML SYS.☆2,005Updated this week
- 从零实现一个小参数量中文大语言模型。☆621Updated 8 months ago
- LLMs interview notes and answers:该仓库主要记录大模型(LLMs)算法工程师相关的面试题和参考答案☆526Updated last year
- 大模型/LLM推理和部署理论与实践☆250Updated 2 months ago
- DL & ML & RS☆353Updated 5 months ago
- Community maintained hardware plugin for vLLM on Ascend☆569Updated last week
- Train a 1B LLM with 1T tokens from scratch by personal☆633Updated last week
- ☆131Updated 2 months ago
- DeepSeek 系列工作解读、扩展和复现。☆634Updated last month
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆891Updated this week
- 看图学大模型☆296Updated 9 months ago
- 通义千问VLLM推理部署DEMO☆576Updated last year
- Learning Large Language Model (LLM)(大语言模型学习)☆649Updated 3 weeks ago
- 校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。☆335Updated last month
- how to learn PyTorch and OneFlow☆427Updated last year
- 该仓库主要记录 大模型(LLMs) 算法工程师相关的面试题☆1,966Updated 4 months ago
- 大模型算法岗面试题(含答案):常见问题和概念解析 "大模型面试题"、"算法岗面试"、"面试常见问题"、"大模型算法面试"、"大模型应用基础"☆861Updated 7 months ago
- 深度学习系统笔记,包含深度学习数学基础知识、神经网络基础部件详解、深度学习炼丹策略、模型压缩算法详解。☆467Updated this week
- 从0开始,将chatgpt的技术路线跑一遍。☆234Updated 8 months ago
- AIInfra(AI 基础设施)指AI系统 从底层芯片等硬件,到上层软件栈支持AI大模型训练和推理。☆2,352Updated last month
- 从零实现一个 llama3 中文版☆868Updated 10 months ago
- CUDA 算子手撕与面试指南☆329Updated 3 months ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,050Updated last week
- An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to infer…☆673Updated last month
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆250Updated 4 months ago
- 中文翻译的 Hands-On-Large-Language-Models (hands-on-llms),动手学习大模型☆838Updated 3 months ago