This is a detailed code demo on how to conduct Full-Param Supervised Fine-tuning (SFT) and DPO (Direct Preference Optimization)
☆21Jan 9, 2025Updated last year
Alternatives and similar repositories for SFT-and-DPO
Users that are interested in SFT-and-DPO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [WACV 2025] Exploiting VLM Localizability and Semantics for Open Vocabulary Action Detection☆17Mar 23, 2025Updated last year
- [🎖️1등(장관상) 솔루션] 2022 국립국어원 인공 지능 언어 능력 평가 (쇼핑몰 리뷰 데이터 속성 기반 감성 분석 : Aspect-Based Sentiment Analysis)☆11Jun 6, 2023Updated 3 years ago
- ☆19Dec 7, 2025Updated 9 months ago
- ☆12Feb 22, 2023Updated 3 years ago
- Crawled Wikipedia Tables with Passages☆14Aug 19, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Object tracking based on SiamFC & DaSiamRPN using GOT-10k toolkit. Demo & Visualization.☆10Jun 29, 2020Updated 6 years ago
- Kimi K2 Thinking Agentic Search Unofficial Implementation☆15Nov 9, 2025Updated 10 months ago
- 本工程代码用于批量实现公开人脸300w/lfpw/afw/helen人脸68个关键点检测训练数据的处理与增强操作，方便后续的训练工作☆16Aug 13, 2019Updated 7 years ago
- Jupyter notebooks for course Finetuning Large Language Models, taught by Sharon Zhou (Lamini) and Andrew Ng (DeepLearning.AI).☆16Oct 21, 2023Updated 2 years ago
- Traffic Light recognition using FasterRCNN in Pytorch☆11Jul 23, 2023Updated 3 years ago
- A simple modification on the official DETR codebase with support to Finetune on custom dataset☆14Nov 26, 2020Updated 5 years ago
- Training PyTorch Faster-RCNN on custom dataset☆14Jun 2, 2021Updated 5 years ago
- 一个简易的美图秀秀☆23May 18, 2026Updated 4 months ago
- Data Science & Machine Learning Project applied to Healthcare☆16Dec 1, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 自然语言处理_CCF大数据与计算智能大赛_面向数据安全治理的数据内容智能发现与分级分类☆11Nov 17, 2022Updated 3 years ago
- 🧀 KoBART summarization using pytorch☆13Jun 7, 2023Updated 3 years ago
- 基于中文的营销文本生成，基于Pointer Generator Network和Converage的实现，此外还尝试各种文本数据增广和优化技巧☆18Sep 5, 2020Updated 6 years ago
- Python port to the normalizer in https://github.com/twitter/twitter-korean-text☆12Apr 26, 2016Updated 10 years ago
- This is the official implementation for the paper: Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models☆19Sep 11, 2024Updated 2 years ago
- The project aims to detect ships in million pixels satellite images using different object detection algorithms. This makes use of variou…☆15Jun 28, 2020Updated 6 years ago
- Driver State Monitoring 驾驶员状态监测，包括：人为遮挡、姿态异常、打哈欠、打电话、抽烟、分神、闭眼检测☆16May 26, 2023Updated 3 years ago
- PyTorch implementation of IRMAE https//arxiv.org/abs/2010.00679☆48Jun 22, 2022Updated 4 years ago
- LoRA supervised fine-tuning, RLHF (PPO) and RAG with llama-3-8B on the TLDR summarization dataset☆14Feb 2, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Semantic and Instance Segmentation on iOS Using a Flask API — DeepLabV3+ and Mask R-CNN☆20Oct 3, 2020Updated 5 years ago
- Image Segmentation On Custom Dataset Using YOLOv8☆19Jan 12, 2023Updated 3 years ago
- ☆13Jun 3, 2020Updated 6 years ago
- 该数据集包括yolo和slp两种格式，数据集中根据与猪只估重和姿态跟踪相关的体表参数，确定关键点。其中yolo格式数据集中除了常规的目标框外，还多了16个关键点；而slp数据集为猪只关键点组成的骨架。☆18May 16, 2023Updated 3 years ago
- Fine tuned llama 3 models for context based question answering in bengali language.☆18Oct 14, 2024Updated last year
- ccf 2020 beike 问答匹配 B榜24名☆12Nov 27, 2022Updated 3 years ago
- gpt-o1 like chain of thoughts with local LLMs in R☆31Oct 15, 2024Updated last year
- ☆14Jul 16, 2021Updated 5 years ago
- memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B☆21May 26, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23May 20, 2021Updated 5 years ago
- A simple repository to remove 'irrelevant for search' words, support for 51 languages☆26Sep 21, 2017Updated 9 years ago
- 文档记录☆15Mar 16, 2021Updated 5 years ago
- Extract the key frame from the tested video, and then search the most similar Images from the database, which consists over 1,4000 pictur…☆10Mar 13, 2014Updated 12 years ago
- A Novel CNN-based Method for Accurate Ship Detection in HR Optical Remote Sensing Images via Rotated Bounding Box☆22May 20, 2020Updated 6 years ago
- 한국어 다중분류 감성분석☆20Jun 7, 2022Updated 4 years ago
- The quantization of CNN/LSTM☆11Mar 26, 2017Updated 9 years ago