Few-Shot Preference Optimization (FSPO) personalizes LLMs by reframing reward modeling as a meta-learning problem, enabling rapid adaptation to user preferences with minimal labeled data, leveraging synthetic datasets for scalability, and achieving high success rates in personalized content generation across multiple domains.
☆17Feb 27, 2025Updated last year
Alternatives and similar repositories for fewshot-preference-optimization
Users that are interested in fewshot-preference-optimization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The open-source repository for PAL: Sample-Efficient Personalized Reward Modeling for Pluralistic Alignment, which provides a general per…☆17Aug 28, 2025Updated last year
- ☆20Sep 16, 2025Updated last year
- Official implementation for Text Generation Beyond Discrete Token Sampling☆26Aug 11, 2025Updated last year
- ☆19Oct 8, 2024Updated 2 years ago
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆17Mar 31, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Agent Droid Bridge gives AI agents programmatic control over Android devices and emulators via ADB, exposed as an MCP server.☆23Jun 30, 2026Updated 4 months ago
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 3 years ago
- official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…☆74Apr 2, 2025Updated last year
- (PyTorch re-implementation) Neural Rating Regression with Abstractive Tips Generation for Recommendation, SIGIR'17☆11Jan 24, 2025Updated last year
- 登录脚本☆12Nov 4, 2022Updated 4 years ago
- ☆14Feb 8, 2022Updated 4 years ago
- [COLM 2026] "Personalized RewardBench: Evaluating Reward Models with Human Aligned Personalization"☆13Apr 9, 2026Updated 7 months ago
- The offical code for paper "What Constitutes a Faithful Summary? Preserving Author Perspectives in News Summarization"☆10Jun 23, 2024Updated 2 years ago
- Speechflow for emotion recognition related information decomposition☆10Jul 27, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 使用Qwen3-ASR模型生成电影字幕☆13Jan 31, 2026Updated 9 months ago
- 深層学習×音楽情報処理勉強会@筑波大学・人と音の情報学研究室☆19Jul 9, 2023Updated 3 years ago
- Official Implementation of "Can Large Language Models Understand Preferences in Personalized Recommendation?"☆11Sep 21, 2026Updated last month
- ☆28Jun 1, 2026Updated 5 months ago
- ICLR 206☆15Aug 18, 2026Updated 3 months ago
- AbstainQA, ACL 2024☆30Feb 4, 2026Updated 9 months ago
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆124Sep 9, 2024Updated 2 years ago
- ☆15Nov 18, 2025Updated last year
- ☆10Jun 15, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆13Apr 17, 2018Updated 8 years ago
- Implementation of Active Flow Expansion (ActFlow), preprint: https://arxiv.org/abs/2606.08802☆26Jun 27, 2026Updated 4 months ago
- Apply Iprompt on GLM with innovative new methods. Currently support Chinese QA, English QA and Chinese poem generation.☆20Jun 16, 2022Updated 4 years ago
- ☆35Jun 21, 2024Updated 2 years ago
- Code for Chain-of-Layer☆12Apr 12, 2024Updated 2 years ago
- PyTorch Implementation for "Hyperbolic Informative Collaborative Filtering(KDD2022)"☆13Jan 15, 2024Updated 2 years ago
- ☆12Jul 6, 2023Updated 3 years ago
- Quantized Evolution Strategies: High-precision Fine-tuning of Quantized LLMs at Low-precision Cost☆22May 14, 2026Updated 6 months ago
- True Few-Shot BioIE: Benchmarking GPT-3 In-Context and Small PLM Fine-Tuning☆12Jul 6, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Jul 20, 2022Updated 4 years ago
- 60k hours of phoneme-aligned audio from audio books☆19Jul 27, 2024Updated 2 years ago
- [KDD 2026 Oral] "Breaking Information Cocoons: A Hyperbolic Graph-LLM Framework for Exploration and Exploitation in Recommender Systems"☆18Jan 29, 2025Updated last year
- AI-Powered Job Search Tool☆19Dec 10, 2025Updated 11 months ago
- ☆16Dec 14, 2022Updated 3 years ago
- Contains the code for my Imperial College London Master's thesis on text summarization☆11Oct 25, 2022Updated 4 years ago
- Official code for our paper "Reasoning Models Hallucinate More: Factuality-Aware Reinforcement Learning for Large Reasoning Models"☆26Oct 31, 2025Updated last year
Are these results useful?