Advanced LLM fine-tuning techniques: SFT (LoRA, QLoRA, DoRA, P-/Prefix-Tuning), GRPO, DPO, ORPO, KTO & PPO; composable correctness/format rewards + LLM-as-a-Judge evals (DeepEval, Evidently AI) across math, multi-hop, medical & general QA on Llama 3, Mistral, Phi-4, Gemma & Qwen3. Built on TRL, PEFT & Unsloth.
☆14Oct 6, 2026Updated 3 weeks ago
Alternatives and similar repositories for llm-finetuning
Users that are interested in llm-finetuning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Advanced RAG pipelines for medical (HealthBench, MedCaseReasoning, MetaMedQA, PubMedQA) and financial (FinanceBench, Earnings Calls) QA. …☆16Oct 6, 2026Updated 3 weeks ago
- Advanced RAG pipeline optimization framework using DSPy. Implements modular RAG pipelines with Query-Rewriting, Sub-Query Decomposition, …☆15Oct 6, 2026Updated 3 weeks ago
- LLM-Blender: Ensembling framework that maximizes LLM performance via pairwise ranking. Employs PairRanker to rank candidates and GenFuser…☆38Jul 22, 2026Updated 3 months ago
- Agentic Graph RAG for Medical diagnosis and Clinical QA. Combines LangGraph-orchestrated multi-hop reasoning with parallel graph, vector,…☆20Updated this week
- 🧠 Workshop Notebook and assets for the Anthropic Hackathon☆12Nov 4, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- generate & query embeddings from VTT files using openai & pinecone on Andrej Karpathy's's latest GPT tutorial☆19Oct 9, 2023Updated 3 years ago
- [ACL 2026] Official implementation of "Quantifying Aleatoric Uncertainty of In-Context Learning for Robust Measure of LLM Prediction Conf…☆13Jun 22, 2026Updated 4 months ago
- Automatically generate comprehensive Pull Request descriptions with LLMs☆29Jan 15, 2025Updated last year
- ☆10Oct 27, 2023Updated 3 years ago
- ☆14May 27, 2026Updated 5 months ago
- Run fast LLM Inference using Llama.cpp in Python☆20Jan 3, 2024Updated 2 years ago
- ☆15Apr 11, 2025Updated last year
- [AAAI 2025] Unleashing the Potential of Model Bias for Generalized Category Discovery☆11Dec 18, 2024Updated last year
- [ECCV 2024] The offical implementation of paper 3D Weakly Supervised Semantic Segmentation with 2D Vision-Language Guidance☆14Mar 23, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The code for "PointGauss: Point Cloud-Guided Multi-Object Segmentation for Gaussian Splatting"☆10Aug 1, 2025Updated last year
- Code Repository for SCM-VAE (IEEE Big Data)