Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu
☆35Jun 3, 2025Updated last year
Alternatives and similar repositories for OWS
Users that are interested in OWS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆30Jul 24, 2025Updated last year
- [ICML 2025] LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning☆12Oct 1, 2025Updated last year
- [TMLR] Official PyTorch implementation of CD-MOE☆12Mar 18, 2026Updated 8 months ago
- ☆42Oct 31, 2024Updated 2 years ago
- Official implementation for "Pruning Large Language Models with Semi-Structural Adaptive Sparse Training" (AAAI 2025)☆20Jul 1, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICLR 2022] "Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity" by Shiwei Liu,…☆27Jun 15, 2022Updated 4 years ago
- ☆19Jan 3, 2025Updated last year
- ☆20Jun 21, 2025Updated last year
- Official implementation for "Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning"☆12Jun 20, 2025Updated last year
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Feb 11, 2023Updated 3 years ago
- [AAAI2023] NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension☆17Dec 20, 2022Updated 3 years ago
- The code of Advancing Expert Specialization for Better MoE (NeurIPS2025 oral)☆35Jan 22, 2026Updated 9 months ago
- EnsembleMOT: A Step towards Ensemble Learning of Multiple Object Tracking☆14Jan 22, 2024Updated 2 years ago
- The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).☆23Oct 2, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [NeurIPS 2025] Ask a Strong LLM Judge when Your Reward Model is Uncertain☆12Oct 23, 2025Updated last year
- [WACV2025] Official PyTorch implementation of TrackDiffusion (https://arxiv.org/abs/2312.00651)☆82Jun 26, 2024Updated 2 years ago
- ☆10May 18, 2025Updated last year
- Official implementation of "Diffusion Language Models Know the Answer Before Decoding"☆62Apr 28, 2026Updated 6 months ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆46Nov 11, 2023Updated 3 years ago
- [ICML 2024]: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models☆11May 19, 2024Updated 2 years ago
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆49Jun 4, 2024Updated 2 years ago
- Code for paper "LLMs Can Evolve Continually on Modality for X-Modal Reasoning" NeurIPS2024☆41Dec 18, 2024Updated last year
- Code for paper "Concrete Subspace Learning based Interference Elimination for Multi-task Model Fusion"☆14Mar 28, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official code for "PCF-GAN: generating sequential data via the characteristic function of measures on the path space"☆13Jan 12, 2025Updated last year
- Verifiable Process Rewards for Agentic Reasoning☆15Oct 13, 2026Updated last month
- [ICLR 2023] 'Revisiting Pruning At Initialization Through The Lens of Ramanujan Graph" by Duc Hoang, Shiwei Liu, Radu Marculescu, Atlas W…☆14Aug 4, 2023Updated 3 years ago
- Code for paper "FineRS: Fine-grained Reasoning and Segmentation of Small Objects with Reinforcement Learning" Neurips2025.☆16Jan 29, 2026Updated 9 months ago
- [NeurIPS 2025] Official Pytorch Implementation of "The Curse of Depth in Large Language Models" by Wenfang Sun, Xinyuan Song, Pengxiang L…☆75Mar 3, 2026Updated 8 months ago
- ☆13Dec 28, 2025Updated 10 months ago
- Extracting Relationships by Multi-Domain Matching☆11Mar 21, 2019Updated 7 years ago
- ☆51Apr 11, 2025Updated last year
- BibexPy is a Python-based software designed to streamline bibliometric data integration, deduplication, metadata enrichment, and format c…☆18Nov 10, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICLR 2026] Official PyTorch implementation for "ReFusion: A Diffusion Large Language Model with Parallel Autoregressive Decoding"☆64Dec 26, 2025Updated 10 months ago
- A Signal Propagation Perspective for Pruning Neural Networks at Initialization☆14Jun 23, 2020Updated 6 years ago
- A repository for LotteryFL re-implementation and experiments☆13Dec 18, 2020Updated 5 years ago
- An easy to use off-policy synthetic data distillation engine for LLMs.☆22Oct 4, 2026Updated last month
- The open-source repository for PAL: Sample-Efficient Personalized Reward Modeling for Pluralistic Alignment, which provides a general per…☆17Aug 28, 2025Updated last year
- Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025☆114Mar 14, 2025Updated last year
- Image retrieval with triplet loss☆17Jun 20, 2018Updated 8 years ago
Are these results useful?