Few-Shot Preference Optimization (FSPO) personalizes LLMs by reframing reward modeling as a meta-learning problem, enabling rapid adaptation to user preferences with minimal labeled data, leveraging synthetic datasets for scalability, and achieving high success rates in personalized content generation across multiple domains.
☆17Feb 27, 2025Updated last year
Alternatives and similar repositories for fewshot-preference-optimization
Users that are interested in fewshot-preference-optimization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆20Sep 16, 2025Updated 11 months ago
- ☆19Oct 8, 2024Updated last year
- Official implementation for Text Generation Beyond Discrete Token Sampling☆26Aug 11, 2025Updated last year
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆17Mar 31, 2025Updated last year
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Speechflow for emotion recognition related information decomposition☆10Jul 27, 2021Updated 5 years ago
- 无人机编队重构☆12Jul 28, 2018Updated 8 years ago
- ☆34Jun 21, 2024Updated 2 years ago
- ☆28Jun 1, 2026Updated 2 months ago
- SECOM: On Memory Construction and Retrieval for Personalized Conversational Agents, ICLR 2025☆62Mar 1, 2025Updated last year
- [KDD 2026] "Breaking Information Cocoons: A Hyperbolic Graph-LLM Framework for Exploration and Exploitation in Recommender Systems"☆16Jan 29, 2025Updated last year
- ☆16Oct 3, 2024Updated last year
- Apply Iprompt on GLM with innovative new methods. Currently support Chinese QA, English QA and Chinese poem generation.☆20Jun 16, 2022Updated 4 years ago
- ☆13Apr 17, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code base for "A General Contextualized Rewriting Framework for Text Summarization"☆13Jul 17, 2022Updated 4 years ago
- Contains the code for my Imperial College London Master's thesis on text summarization☆11Oct 25, 2022Updated 3 years ago
- On-the-fly Definition Augmentation of LLMs for Biomedical NER☆14Apr 14, 2025Updated last year
- [ICRA 2024] WLST: Weak Labels Guided Self-training for Weakly-supervised Domain Adaptation on 3D Object Detection☆12Feb 6, 2024Updated 2 years ago
- ☆12Jul 6, 2023Updated 3 years ago
- ☆14Sep 7, 2022Updated 3 years ago
- this is based on the paper Chain-of-Retrieval Augmented Generation☆15Mar 29, 2025Updated last year
- ☆12Jan 20, 2024Updated 2 years ago
- ☆20Feb 17, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Basic Tools☆13Dec 18, 2021Updated 4 years ago
- ☆12Mar 24, 2023Updated 3 years ago
- Code for the paper "Spectral Editing of Activations for Large Language Model Alignments"☆31Dec 20, 2024Updated last year
- GraphDancer: Training LLMs to Explore and Reason over Graphs via Curriculum Reinforcement Learning☆20May 25, 2026Updated 3 months ago
- A simple Docker sandbox example and a ready-to-use autograder API. Based on asynchronous FastAPI and disposable Docker containers. Three …☆15Jan 10, 2022Updated 4 years ago
- How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?☆13Aug 16, 2023Updated 3 years ago
- tacotronV2 + wavernn 实现中文语音合成(Tensorflow + pytorch)☆15May 20, 2020Updated 6 years ago
- [NeurIPS 2025] CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehension☆22Oct 8, 2025Updated 10 months ago
- Code accompanying ICCC 2019 Creative Submission paper - "ChordAL: A Chord-Based Approach for Music Generation using Bi-LSTMs".☆19Mar 4, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official implementation of paper "Learning High-Order Relationships of Brain Regions" [ICML 2024]☆24May 29, 2025Updated last year
- ☆16Jul 10, 2022Updated 4 years ago
- ☆25Oct 23, 2025Updated 10 months ago
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆35Apr 17, 2025Updated last year
- Code to reproduce results of our experiments using LoRe☆18Jun 10, 2026Updated 2 months ago
- Code repo for EMNLP 2023 paper "Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models"☆23Nov 13, 2023Updated 2 years ago
- ☆156Mar 31, 2026Updated 4 months ago