Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu
☆35Jun 3, 2025Updated 8 months ago
Alternatives and similar repositories for OWS
Users that are interested in OWS are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆29Jul 24, 2025Updated 7 months ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆36Apr 4, 2024Updated last year
- ☆24Sep 26, 2025Updated 5 months ago
- Official PyTorch implementation of CD-MOE☆12Mar 29, 2025Updated 11 months ago
- ☆19Jun 21, 2025Updated 8 months ago
- ☆17Dec 9, 2024Updated last year
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Apr 21, 2025Updated 10 months ago
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆81Jul 7, 2025Updated 7 months ago
- ☆19Jan 3, 2025Updated last year
- FireQ: Fast INT4-FP8 Kernel and RoPE-aware Quantization for LLM Inference Acceleration☆20Jun 27, 2025Updated 8 months ago
- [ICLR 2022] "Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity" by Shiwei Liu,…☆27Jun 15, 2022Updated 3 years ago
- Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training☆36Jun 20, 2025Updated 8 months ago
- a training-free approach to accelerate ViTs and VLMs by pruning redundant tokens based on similarity☆43May 24, 2025Updated 9 months ago
- Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025☆101Mar 14, 2025Updated 11 months ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Feb 11, 2023Updated 3 years ago
- Python code to help read ASEG GDF2 packages☆11Feb 17, 2026Updated last week
- Data access library for the MeerKAT radio telescope☆13Jan 21, 2026Updated last month
- ☆11Feb 19, 2022Updated 4 years ago
- ☆12Dec 19, 2024Updated last year
- ☆11Mar 6, 2024Updated last year
- Statistician is a framework of tools for generating statistical summaries of large collections of EO data managed in an ODC instance.☆12Jan 27, 2026Updated last month
- ☆12May 18, 2025Updated 9 months ago
- Public repository for the domain-specific Portuguese word embedding models for the Oil and Gas Industry☆11Apr 15, 2021Updated 4 years ago
- Home of the Martini 3 Sterol Parameters☆13Oct 10, 2023Updated 2 years ago
- Release code for "A Bayesian formulation for estimating the composition of Earth's crust"☆10Apr 16, 2023Updated 2 years ago
- [PR 2024] Official PyTorch Code for "Dual Teachers for Self-Knowledge Distillation"☆13Nov 28, 2024Updated last year
- [CVPR 2025 Highlight] FIMA-Q: Post-Training Quantization for Vision Transformers by Fisher Information Matrix Approximation☆26Jun 16, 2025Updated 8 months ago
- ☆14Apr 20, 2021Updated 4 years ago
- A QGIS plugin for mineral prospectivity mapping☆17Jul 3, 2025Updated 7 months ago
- Helper code for the 2021 Kaggle NFL Helmet Assignment Task☆13Sep 22, 2021Updated 4 years ago
- Project overview, roadmap and initial result reports☆11Aug 6, 2022Updated 3 years ago
- Model architecture for the ThinkOnward Geophysical Foundation Model☆16May 16, 2025Updated 9 months ago
- This is a python toolkit and developer version package to estimate multidimensional aspects of greenness and nature exposure, such as ava…☆12Aug 27, 2023Updated 2 years ago
- Parse geosoft (GRD) grid and save as geotiff☆11May 16, 2023Updated 2 years ago
- Materials for Structural geology 2 course☆11Nov 11, 2019Updated 6 years ago
- AuScope Geoscience Models Portal☆10Feb 17, 2026Updated last week
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆50Apr 9, 2024Updated last year
- Machine learning Algorithm for Radiative transfer of Generated Exoplanets☆12Aug 15, 2025Updated 6 months ago
- Determine appropriate chunk sizes for a given xarray dataset based on target chunk size and 'chunk aspect ratio'☆15Apr 16, 2024Updated last year