[原理解析] 大模型基本功（手撕Transformer模型、手撕PPO、GRPO、DPO训练器）
☆29Jul 8, 2025Updated last year
Alternatives and similar repositories for llm_scratch
Users that are interested in llm_scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A travel agent based on Qwen2.5, fine-tuned by SFT + DPO/PPO/GRPO using traveling question-answer dataset, a mindmap can be output using …☆80Jul 6, 2026Updated 2 weeks ago
- 从零预训练LLM、SFT、RLHF、DPO笔记整理+面试问题☆21Sep 2, 2024Updated last year
- Official Code for All-in-One Medical Image Re-Identification (CVPR2025)☆20Jan 11, 2026Updated 6 months ago
- A transparent, single-file implementation for understanding GRPO (K1 in Rewards), free from the abstractions of large libraries.☆87Feb 14, 2026Updated 5 months ago
- [ACL 2026] WikiSeeker: Rethinking the Role of Vision-Language Models in Knowledge-Based Visual Question Answering.☆15Apr 18, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 可见光/红外光双模态目标检测: C2Former在MMDetection（Cascade-RCNN）上的实现☆18Dec 1, 2025Updated 7 months ago
- 🚀 2026届大模型算法岗实习面经 | 包含 DeepSeek/Qwen 技术报告解析、手撕 PPO/RoPE/Transformer、RLHF 核心与八股文 | 持续更新中...☆608Mar 28, 2026Updated 3 months ago
- Official Implementation of Infinite-Resolution Integral Noise Warping for Diffusion Models [ICLR 2025]☆16Mar 15, 2025Updated last year
- ☆46Jun 7, 2026Updated last month
- ☆12Mar 15, 2023Updated 3 years ago
- [CVPR-26] Official repository of "CaTok: Taming Mean Flows for One-Dimensional Causal Image Tokenization"☆19Mar 9, 2026Updated 4 months ago
- [ACM TOIS] Multi-Behavior Recommendation with Personalized Directed Acyclic Behavior Graphs☆13Dec 6, 2024Updated last year
- 🌞 CareLlama (关怀羊驼)是一个医疗大语言模型，同时它集合了数十个公开可用的医疗微调数据集和开放可用的医疗大语言模型以促进医疗LLM快速发展。Medical LLM, Open Source Driven for a Healthy Future.☆45Aug 24, 2023Updated 2 years ago
- [IEEE TKDE] A LLM-based Recommender System with user&item Tokenizers and a generative retrieval paradigm.☆31Mar 11, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Jul 13, 2022Updated 4 years ago
- [MIR] Pytorch Implementation for FM2S, a denoising algorithm for fluorescence microscopy.☆15Mar 13, 2026Updated 4 months ago
- 手撕transformer并完成一个简单的机 器翻译。☆23Feb 19, 2025Updated last year
- The official implementation of Preference Data Reward-Augmentation.☆18May 1, 2025Updated last year
- A PyTorch implementation of Speech Transformer with multi-GPUs, an End-to-End ASR with Transformer network on Mandarin Chinese. This code…☆10Dec 25, 2019Updated 6 years ago
- LAReQA is a challenging benchmark for evaluating language agnostic answer retrieval from a multilingual candidate pool. This repository c…☆14May 19, 2020Updated 6 years ago
- ☆16May 22, 2025Updated last year
- ☆11Aug 5, 2022Updated 3 years ago
- Spatial-Temporal Knowledge-Embedded Transformer for Video Scene Graph Generation (TIP 2024, ACM MM 2023)☆19Mar 13, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 条件随机场（CRF）的pytorch实现☆10Mar 7, 2021Updated 5 years ago
- This repository follows papers and reports on discrete speech representation learning and speech tokenization methods for speech language…☆15Dec 1, 2023Updated 2 years ago
- Official pytorch implementation of Cross Modality Knowledge Distillation between A-mode Ultrasound and Surface Electromyography.☆14May 23, 2023Updated 3 years ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- Video-Language Alignment via Spatio–Temporal Graph Transformer; ArXiv: https://arxiv.org/abs/2407.11677☆15Jul 24, 2024Updated last year
- Imitation Learning Platform For Embodied AI.☆23Dec 30, 2025Updated 6 months ago
- ☆15May 27, 2025Updated last year
- 基于电商数据微调的Qwen1.5系列的电商大模型，包括0.5b-base，0.5b-chat，1.8b-base，7b-base，以及基于llama3-chinese-sft版本的基础模型的sft后电商大模型。☆25May 14, 2024Updated 2 years ago
- ☆14Feb 28, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Alpha,deap,数字货币☆14Dec 9, 2020Updated 5 years ago
- 基于资金流的择时选股策略☆18May 25, 2018Updated 8 years ago
- Code for "ConsistentChat: Building Skeleton-Guided Consistent Multi-Turn Dialogues for Large Language Models from Scratch", where dataset…☆16Sep 8, 2025Updated 10 months ago
- 丁立中的大模型算法工程作品集。聚焦 LLM / VLM 全链路的复现与优化，涵盖：① 预训练与微调（Pretrain / SFT / MoE / 多模态对齐）；② 强化学习对齐（PPO / GRPO / DAPO，含多奖励函数与 GAE）；③ 知识蒸馏（离线 KL 蒸馏、在…☆17May 26, 2026Updated last month
- ☆10Apr 30, 2025Updated last year
- published in Biomedical Signal Processing and Control☆12May 16, 2020Updated 6 years ago
- verify OrderBook Tick Data Trading Strategy on futures.☆17Mar 21, 2019Updated 7 years ago