Model souping for LLMs
☆75Nov 18, 2025Updated 9 months ago
Alternatives and similar repositories for llm_souping
Users that are interested in llm_souping are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official implementation of NOSA☆20Jun 11, 2026Updated 2 months ago
- RePo: Language Models with Context Re-Positioning☆84Mar 30, 2026Updated 5 months ago
- ☆14Oct 11, 2023Updated 2 years ago
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated 11 months ago
- Multi-stage LLM agent pipeline for optimizing Triton kernels on Intel XPU — from analysis to autotuning.☆21Aug 28, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICLR 2026]QeRL enables RL for 32B LLMs on a single H100 GPU.☆518Mar 30, 2026Updated 5 months ago
- ☆63Jul 10, 2025Updated last year
- REverse-Engineered Reasoning for Open-Ended Generation☆98Sep 10, 2025Updated 11 months ago
- This repository contains code for the MicroAdam paper.☆21Dec 14, 2024Updated last year
- Extending the Context of Pretrained LLMs by Dropping Their Positional Embedding☆222Jan 12, 2026Updated 7 months ago
- [ICLR 2026] The official implementation of the paper “Anchored Supervised Fine-Tuning”☆50Jun 19, 2026Updated 2 months ago
- Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM☆14Dec 27, 2023Updated 2 years ago
- Source code to accompany research paper on training multi token prediction language models using self-distillation.☆43Feb 21, 2026Updated 6 months ago
- High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning☆56Jul 23, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆92Jun 20, 2025Updated last year
- ☆16Feb 6, 2024Updated 2 years ago
- A pytorch implementation of the ICCV2021 workshop paper SimDis: Simple Distillation Baselines for Improving Small Self-supervised Models☆14Jul 15, 2021Updated 5 years ago
- Official repository for Activation-Informed Merging (AIM) of Large Language Models☆25Feb 10, 2025Updated last year
- ☆17Apr 10, 2025Updated last year
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆17Apr 30, 2025Updated last year
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆31Nov 4, 2024Updated last year
- Official Repository of "[ICLR26] TRAPO: A Semi-Supervised Reinforcement Learning Framework for Boosting LLM Reasoning"☆30Feb 6, 2026Updated 7 months ago
- Official JAX implementation of End-to-End Test-Time Training for Long Context☆693Feb 15, 2026Updated 6 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Fused KL divergence from hidden states for knowledge distillation☆22Apr 28, 2026Updated 4 months ago
- Official implementation for DenseMixer: Improving MoE Post-Training with Precise Router Gradient☆68Aug 3, 2025Updated last year
- Official implementation of Tabular Transfer Learning via Prompting LLMs (COLM 2024).☆13Aug 6, 2024Updated 2 years ago
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated last year
- [ICML 2026] An Evaluation Suite for Chain-of-Thought Controllability☆53Mar 10, 2026Updated 5 months ago
- Data pipeline for HRM-Text pretraining☆74May 21, 2026Updated 3 months ago
- A demonstration of the paper NER Retriever: Zero-Shot Named Entity Retrieval with Type-Aware Embeddings☆39Sep 13, 2025Updated 11 months ago
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆62Mar 17, 2025Updated last year
- AIRS-Bench: an AI Research Science benchmark for quantifying the end-to-end AI research abilities of LLM agents☆115May 5, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The open-source code for the NeurIPS 2025 paper, "Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learn…☆68Jan 5, 2026Updated 8 months ago
- Low-probability Tokens Sustain Exploration in Reinforcement Learning with Verifiable Reward☆44Nov 18, 2025Updated 9 months ago
- BERT score for text generation☆12Jan 15, 2025Updated last year
- ☆18Jun 2, 2026Updated 3 months ago
- ☆14Mar 4, 2024Updated 2 years ago
- [ICLR'26] "Nabla-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space" by Peihao Wang*, Ruisi Cai*, Zhen Wang, Hongyuan…☆36Mar 10, 2026Updated 5 months ago
- ICCV 2023 - AdaptGuard: Defending Against Universal Attacks for Model Adaptation☆11Dec 23, 2023Updated 2 years ago