从零预训练LLM、SFT、RLHF、DPO笔记整理+面试问题
☆21Sep 2, 2024Updated 2 years ago
Alternatives and similar repositories for LLM_Learning_ph
Users that are interested in LLM_Learning_ph are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [原理解析] 大模型基本功(手撕Transformer模型、手撕PPO、GRPO、DPO训练器)☆33Jul 8, 2025Updated last year
- 🔥🔥🔥 基于 PyTorch Lightning 和 MIND 数据集的模块化新闻推荐系统框架。实现了从特征工程到召回 (DSSM) 与排序 (Deep, DCN, WideDeep, FM) 的完整链路。☆49Apr 12, 2026Updated 7 months ago
- Systems biology tool: Boolean network simulator☆13Feb 21, 2021Updated 5 years ago
- ☆13Mar 23, 2025Updated last year
- The implementations of paper "Reinforced Preference Optimization for Recommendation" (ReRe).☆24Sep 10, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 基于Qwen2+SFT+DPO的医疗问答系统,项目中使用了自定义的 SFTTrainer/DPOTrainer/TRPOTrainer用于训练,其次,项目还调用各种知识库工具(neo4j, milvus, LDA, 等)进行自动化训练数据生成。另外,使用 vllm 用于推理…☆90Apr 29, 2026Updated 6 months ago
- 知识图谱和RAG大模型结合实现智能问答与推理☆11May 15, 2024Updated 2 years ago
- ☆12Jun 23, 2023Updated 3 years ago
- 江科大Java实训☆11Dec 1, 2020Updated 5 years ago
- 基于 Qwen/Qwen3-0.6B 的医疗问答微调与推理示例项目,记录健康数据、生成建议与报告☆16Sep 30, 2025Updated last year
- A huggingface data loader for CWQ dataset☆11Apr 28, 2025Updated last year
- LLM 面试手撕代码分享☆27Jun 2, 2026Updated 5 months ago
- Hermes Agent 主动消息方案☆15Sep 28, 2026Updated last month
- 这是一个open-r1的复现项目,对0.5B、1.5B、3B、7B的qwen模型进行GRPO训练,观察到一些有趣的现象。☆62Apr 13, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11May 27, 2023Updated 3 years ago
- ☆124May 29, 2025Updated last year
- My implementation in TianChi CCKS 2025 pdf QA multimodal competition☆19Aug 27, 2025Updated last year
- LLM手撕代码合集☆24Mar 25, 2025Updated last year
- A web video editor utilizing Vue.js and WebGL/OpenGL, delivering ultimate high performance.Aoles GL 是一个专业级 Web 视频编辑器组件库。☆12Aug 10, 2026Updated 3 months ago
- Ressys benchmark code repo☆12Dec 5, 2025Updated 11 months ago
- ☆10Oct 16, 2024Updated 2 years ago
- Code for Analyzing Redundancy in Pretrained Transformer Models accepted at EMNLP 2020☆14Oct 6, 2020Updated 6 years ago
- Erasing conceptual knowledge from language models through low-rank fine-tuning☆25Mar 27, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A very simple navigational search homepage with a background using Bing's image API and support for adding search engines on your own.☆10Jan 19, 2026Updated 10 months ago
- 基于BERT-MRC(阅读理解)的命名实体识别模型☆20Mar 15, 2022Updated 4 years ago
- pdf multimodal rag 【pdf多模态rag问答】☆30Feb 26, 2025Updated last year
- [ICML 2022] This work investigates the compatibility between label smoothing (LS) and knowledge distillation (KD). We suggest to use an L…☆13Dec 8, 2022Updated 3 years ago
- This repo contains some extensions of deepspeed-chat for fine-tuning LLMs (SFT+RLHF).☆21Jul 2, 2024Updated 2 years ago
- VHDL Implementation☆15Oct 9, 2014Updated 12 years ago
- 本项目将基于多模态,RAG以及LLM等技术,打造了一个基于手相算命的系统☆30Aug 28, 2024Updated 2 years ago
- [CVPR2023] Practical Network Acceleration with Tiny Sets☆13Jul 28, 2023Updated 3 years ago
- 一个轻量级代理服务,通过逆向豆包 Web API,将其转换为标准 OpenAI Chat Completions 接口格式。☆12Sep 25, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆16Dec 21, 2025Updated 10 months ago
- ☆12Feb 20, 2025Updated last year
- Forked from *OneIE: A Joint Neural Model for Information Extraction with Global Features*☆21Sep 4, 2022Updated 4 years ago
- ☆31Aug 19, 2026Updated 3 months ago
- Advanced LLM fine-tuning techniques: SFT (LoRA, QLoRA, DoRA, P-/Prefix-Tuning), GRPO, DPO, ORPO, KTO & PPO; composable correctness/format…☆14Nov 3, 2026Updated 2 weeks ago
- Code and data of WSDM 2023 paper "Hansel: A Chinese Few-Shot and Zero-Shot Entity Linking Benchmark".☆24Jun 1, 2023Updated 3 years ago
- 智能客服系统架构与多Agent协作☆34Oct 9, 2025Updated last year
Are these results useful?