[原理解析] 大模型基本功(手撕Transformer模型、手撕PPO、GRPO、DPO训练器)
☆33Jul 8, 2025Updated last year
Alternatives and similar repositories for llm_scratch
Users that are interested in llm_scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A transparent, single-file implementation for understanding GRPO (K1 in Rewards), free from the abstractions of large libraries.☆91Feb 14, 2026Updated 7 months ago
- PipelineLLM 是一个系统性的大语言模型(LLM)后训练学习项目,涵盖从监督微调(SFT)到偏好优化(DPO)、强化学习(RLHF/PPO/GRPO)再到持续学习(Continual Learning)的完整技术栈。☆37Jan 16, 2026Updated 8 months ago
- Masked Autoencoders for Unsupervised Anomaly Detection in Medical Images☆21Aug 15, 2023Updated 3 years ago
- LLM中相关RLHF算法实现与学习☆15Apr 13, 2025Updated last year
- 🚀 2026届大模型算法岗实习面经 | 包含 DeepSeek/Qwen 技术报告解析、手撕 PPO/RoPE/Transformer、RLHF 核心与八股文 | 持续更新中...☆701Mar 28, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official Implementation of Infinite-Resolution Integral Noise Warping for Diffusion Models [ICLR 2025]☆16Mar 15, 2025Updated last year
- 在监控画质下实现对校园自行车的重识别,包含REID模型识别,向量数据库检索,UI展示☆11Feb 13, 2024Updated 2 years ago
- A project using YoloV8 to detect License Plates☆13Sep 29, 2023Updated 3 years ago
- [CVPR-26] Official repository of "CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenization"☆19Mar 9, 2026Updated 7 months ago
- Demo app with Loguru logging, async middleware to generate X-request-Id. Works with Gunicorn or Uvicorn, and is safe to use with async/th…☆10Feb 2, 2022Updated 4 years ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- Official PyTorch implementation for "Where You Edit is What You Get: Text-Guided Image Editing with Region-Based Attention" (Pattern Reco…☆10Oct 1, 2024Updated 2 years ago
- ☆17Jul 30, 2016Updated 10 years ago
- A PyTorch implementation of Speech Transformer with multi-GPUs, an End-to-End ASR with Transformer network on Mandarin Chinese. This code…☆10Dec 25, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The official implementation of Preference Data Reward-Augmentation.☆18May 1, 2025Updated last year
- ☆12Jul 19, 2020Updated 6 years ago
- Official PyTorch code for "Vector Quantization Prompting for Continual Learning (NeurIPS2024)".☆11Oct 16, 2024Updated last year
- ☆12Aug 5, 2022Updated 4 years ago
- Spatial-Temporal Knowledge-Embedded Transformer for Video Scene Graph Generation (TIP 2024, ACM MM 2023)☆19Mar 13, 2024Updated 2 years ago
- SDD 规格驱动开发 + Harness 多 Agent 编排;支持在 OpenCode、Claude Code、Codex CLI 间切换执行引擎,完成从规格到落地的自动化开发任务。☆15Apr 8, 2026Updated 6 months ago
- [MIR] Pytorch Implementation for FM2S, a denoising algorithm for fluorescence microscopy.☆15Mar 13, 2026Updated 6 months ago
- Official pytorch implementation of Cross Modality Knowledge Distillation between A-mode Ultrasound and Surface Electromyography.☆14May 23, 2023Updated 3 years ago
- Published in Nature Communications☆12Feb 19, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Video-Language Alignment via Spatio–Temporal Graph Transformer; ArXiv: https://arxiv.org/abs/2407.11677☆15Jul 24, 2024Updated 2 years ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- ☆15May 27, 2025Updated last year
- This repository contain the code we used to divide NinaPro database 5 into train set and test set☆10Mar 14, 2019Updated 7 years ago
- ☆15Dec 11, 2024Updated last year
- ☆14Feb 28, 2019Updated 7 years ago
- Alpha,deap,数字货币☆14Dec 9, 2020Updated 5 years ago
- Official PyTorch Implementation of Guarding Barlow Twins Against Overfitting with Mixed Samples☆19Jan 19, 2024Updated 2 years ago
- Code for "ConsistentChat: Building Skeleton-Guided Consistent Multi-Turn Dialogues for Large Language Models from Scratch", where dataset…☆17Sep 8, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 丁立中的大模型算法工程作品集。聚焦 LLM / VLM 全链路的复现与优化,涵盖:① 预训练与微调(Pretrain / SFT / MoE / 多模态对齐);② 强化学习对齐(PPO / GRPO / DAPO,含多奖励函数与 GAE);③ 知识蒸馏(离线 KL 蒸馏、在…☆17May 26, 2026Updated 4 months ago
- Official implementation of 'RiskPO: Risk-based Policy Optimization via Verifiable Reward for LLM Post-Training', accepted by ICLR 2026☆19Oct 15, 2025Updated 11 months ago
- ☆10Apr 30, 2025Updated last year
- verify OrderBook Tick Data Trading Strategy on futures.☆17Mar 21, 2019Updated 7 years ago
- Benchmarking Panoptic Video Scene Graph Generation (PVSG), CVPR'23☆103Apr 30, 2024Updated 2 years ago
- 🚀 An AI-powered resume tailoring tool & interview predictor. Local-first for privacy. | 告别海投!基于大模型的本地化简历定制神器:输入全量履历和目标JD,一键生成高匹配度简历并智能预测…☆23Mar 15, 2026Updated 6 months ago
- ☆17Aug 1, 2025Updated last year