[原理解析] 大模型基本功(手撕Transformer模型、手撕PPO、GRPO、DPO训练器)
☆33Jul 8, 2025Updated last year
Alternatives and similar repositories for llm_scratch
Users that are interested in llm_scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A travel agent based on Qwen2.5, fine-tuned by SFT + DPO/PPO/GRPO using traveling question-answer dataset, a mindmap can be output using …☆83Jul 6, 2026Updated 2 months ago
- 从零预训练LLM、SFT、RLHF、DPO笔记整理+面试问题☆21Sep 2, 2024Updated 2 years ago
- DoctorRAG is a medical AI that mimics doctor-like reasoning by combining textbook knowledge with insights from similar patient cases, usi…☆22May 21, 2025Updated last year
- Code for "Linear Mechanisms for Spatiotemporal Reasoning in Vision Language Models"☆20Feb 16, 2026Updated 7 months ago
- A transparent, single-file implementation for understanding GRPO (K1 in Rewards), free from the abstractions of large libraries.☆90Feb 14, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- PipelineLLM 是一个系统性的大语言模型(LLM)后训练学习项目,涵盖从监督微调(SFT)到偏好优化(DPO)、强化学习(RLHF/PPO/GRPO)再到持续学习(Continual Learning)的完整技术栈。☆35Jan 16, 2026Updated 8 months ago
- Masked Autoencoders for Unsupervised Anomaly Detection in Medical Images☆21Aug 15, 2023Updated 3 years ago
- [ACL 2026] WikiSeeker: Rethinking the Role of Vision-Language Models in Knowledge-Based Visual Question Answering.☆16Jul 25, 2026Updated last month
- Notes on Virtual Try-On Paper.记录一些经典虚拟试穿论文的笔记。☆11Jan 3, 2025Updated last year
- 本地化 RAG 智能体应用,基于 Python(Qwen Agent)和 Gradio WebUI,集成 Elasticsearch、多模型与可视化界面,助力企业快速搭建私有知识库问答系统。| Local RAG agent app with Python (Qwen Ag…☆18Jul 28, 2025Updated last year
- 🚀 2026届大模型算法岗实习面经 | 包含 DeepSeek/Qwen 技术报告解析、手撕 PPO/RoPE/Transformer、RLHF 核心与八股文 | 持续更新中...☆688Mar 28, 2026Updated 5 months ago
- Official Implementation of Infinite-Resolution Integral Noise Warping for Diffusion Models [ICLR 2025]☆16Mar 15, 2025Updated last year
- ☆50Jun 7, 2026Updated 3 months ago
- [CVPR-26] Official repository of "CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenization"☆19Mar 9, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ACM TOIS] Multi-Behavior Recommendation with Personalized Directed Acyclic Behavior Graphs☆13Dec 6, 2024Updated last year
- 包含了LLM的一些手撕代码,如强化学习。可以帮助从代码层面深入理解原理,以及有助于准备大模型面试可能出现的手撕。后续会更新Transformer等更多手撕☆134Mar 15, 2026Updated 6 months ago
- Official PyTorch implementation for "Where You Edit is What You Get: Text-Guided Image Editing with Region-Based Attention" (Pattern Reco…☆10Oct 1, 2024Updated last year
- [IEEE TKDE] A LLM-based Recommender System with user&item Tokenizers and a generative retrieval paradigm.☆32Mar 11, 2026Updated 6 months ago
- The official implementation of Preference Data Reward-Augmentation.☆18May 1, 2025Updated last year
- Official PyTorch code for "Vector Quantization Prompting for Continual Learning (NeurIPS2024)".☆11Oct 16, 2024Updated last year
- ☆12Jul 19, 2020Updated 6 years ago
- ☆12Aug 5, 2022Updated 4 years ago
- ☆11May 27, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [MIR] Pytorch Implementation for FM2S, a denoising algorithm for fluorescence microscopy.☆15Mar 13, 2026Updated 6 months ago
- A curated list of Awesome Multi-User Agents resources☆19Jul 11, 2026Updated 2 months ago
- Official pytorch implementation of Cross Modality Knowledge Distillation between A-mode Ultrasound and Surface Electromyography.☆14May 23, 2023Updated 3 years ago
- ☆15May 27, 2025Updated last year
- This repository contain the code we used to divide NinaPro database 5 into train set and test set☆10Mar 14, 2019Updated 7 years ago
- My implementation in TianChi CCKS 2025 pdf QA multimodal competition☆19Aug 27, 2025Updated last year
- Code for "ConsistentChat: Building Skeleton-Guided Consistent Multi-Turn Dialogues for Large Language Models from Scratch", where dataset…☆17Sep 8, 2025Updated last year
- 基于资金流的择时选股策略☆18May 25, 2018Updated 8 years ago
- Official implementation of 'RiskPO: Risk-based Policy Optimization via Verifiable Reward for LLM Post-Training', accepted by ICLR 2026☆19Oct 15, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ASR for dysarthric speakers with Kaldi☆13Jan 14, 2017Updated 9 years ago
- verify OrderBook Tick Data Trading Strategy on futures.☆17Mar 21, 2019Updated 7 years ago
- 这个项目是一个医疗智能诊断助手系统,简单说就是:> 你输入病人的症状,AI系统会像一个经验丰富的医生团队一样,查阅大量病例文献,进行分析推理,然后给出诊断建议和治疗方案。☆38Sep 24, 2025Updated 11 months ago
- Benchmarking Panoptic Video Scene Graph Generation (PVSG), CVPR'23☆103Apr 30, 2024Updated 2 years ago
- [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention☆69Jul 16, 2024Updated 2 years ago
- 山东省第二届数据应用创新创业大赛-主赛场-检验报告单识别-Baseline☆13Jan 15, 2021Updated 5 years ago
- Official implementation of "CONCRETE: Improving Cross-lingual Fact Checking with Cross-lingual Retrieval" (COLING'22)☆16Oct 13, 2022Updated 3 years ago