This is a detailed code demo on how to conduct Full-Param Supervised Fine-tuning (SFT) and DPO (Direct Preference Optimization)
☆19Jan 9, 2025Updated last year
Alternatives and similar repositories for SFT-and-DPO
Users that are interested in SFT-and-DPO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the code repo for our paper "Say More with Less: Understanding Prompt Learning Behaviors through Gist Compression".☆13Feb 27, 2024Updated 2 years ago
- The code for “PromptNER: A Prompting Method for Few-shot Named Entity Recognition via k Nearest Neighbor Search”☆19Mar 13, 2024Updated 2 years ago
- ☆17Nov 8, 2023Updated 2 years ago
- Official Codebase for "Aligning Diffusion Behaviors with Q-functions for Efficient Continuous Control" (NeurIPS 2024)☆15Oct 29, 2024Updated last year
- LLM KV Cache compression - K+V dual compression, 73-99% VRAM savings, zero accuracy loss☆51Mar 30, 2026Updated last month
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆16Jul 12, 2024Updated last year
- ☆12Feb 22, 2023Updated 3 years ago
- [🎖️1등(장관상) 솔루션] 2022 국립국어원 인공 지능 언어 능력 평가 (쇼핑몰 리뷰 데이터 속성 기반 감성 분석 : Aspect-Based Sentiment Analysis)☆11Jun 6, 2023Updated 2 years ago
- Text Adventure Learning Environment Suite - Benchmark to evaluate language models on interactive text environments.☆27May 1, 2026Updated last week
- A simple implementation of ReasonGenRM.☆19Apr 21, 2025Updated last year
- I modified some code of K-BERT so that it can be fit to English datasets Topics Resources☆11Dec 15, 2022Updated 3 years ago
- 2018 京东AI时尚挑战赛，时尚风格识别冠军（All source code ）☆12Sep 13, 2018Updated 7 years ago
- A simple modification on the official DETR codebase with support to Finetune on custom dataset☆14Nov 26, 2020Updated 5 years ago
- ☆21Aug 18, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 🧀 KoBART summarization using pytorch☆13Jun 7, 2023Updated 2 years ago
- Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed☆21May 27, 2024Updated last year
- [ICML 2025] Official code of "AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization"☆31Jan 10, 2026Updated 3 months ago
- MSRSegNet: Multi-Scale Residual Network for Semantic Segmentation☆10Aug 9, 2018Updated 7 years ago
- 复现Wav2Lip作者新的论文☆20Jun 20, 2023Updated 2 years ago
- 特征离散化方法总结☆18Nov 11, 2020Updated 5 years ago
- 中文短剧本☆36Apr 17, 2019Updated 7 years ago
- LLama3中文个人版本☆39Apr 26, 2024Updated 2 years ago
- FaceFormer Emo: Speech-Driven 3D Facial Animation with Emotion Embedding☆27Jul 15, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Driver State Monitoring 驾驶员状态监测，包括：人为遮挡、姿态异常、打哈欠、打电话、抽烟、分神、闭眼检测☆16May 26, 2023Updated 2 years ago
- 文档记录☆15Mar 16, 2021Updated 5 years ago
- ☆13Jun 3, 2020Updated 5 years ago
- ☆10Oct 23, 2017Updated 8 years ago
- ☆60Mar 8, 2025Updated last year
- This is a submission example for CelebA-Spoof Challenge participants.☆10Sep 8, 2020Updated 5 years ago
- ccf 2020 beike 问答匹配 B榜24名☆12Nov 27, 2022Updated 3 years ago
- I love reinforcement learning.☆13Jan 15, 2025Updated last year
- Extract the key frame from the tested video, and then search the most similar Images from the database, which consists over 1,4000 pictur…☆10Mar 13, 2014Updated 12 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23May 20, 2021Updated 4 years ago
- Code execution sandbox(support Open-R1), Supports multiple languages(Python/Java/C/Kotlin/Swift/OC/GO/...)☆23Mar 6, 2025Updated last year
- [ICLR 2026] PSFT is a trust-region–inspired fine-tuning objective that views SFT as a policy gradient method with constant advantages, co…☆38Sep 9, 2025Updated 8 months ago
- A simple implementation of LoRA+: Efficient Low Rank Adaptation of Large Models☆10Mar 20, 2024Updated 2 years ago
- pytorch版simcse无监督语义相似模型☆22May 13, 2021Updated 4 years ago
- My personal website.☆24Mar 9, 2026Updated 2 months ago
- ☆32Mar 5, 2025Updated last year