[ICLR 2023] "Learning to Grow Pretrained Models for Efficient Transformer Training" by Peihao Wang, Rameswar Panda, Lucas Torroba Hennigen, Philip Greengard, Leonid Karlinsky, Rogerio Feris, David Cox, Zhangyang Wang, Yoon Kim
☆93Feb 26, 2024Updated 2 years ago
Alternatives and similar repositories for LiGO
Users that are interested in LiGO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2022] "Randomized Channel Shuffling: Minimal-Overhead Backdoor Attack Detection without Clean Datasets" by Ruisi Cai*, Zhenyu Zh…☆21Oct 1, 2022Updated 4 years ago
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆13May 31, 2023Updated 3 years ago
- Masked Structural Growth for 2x Faster Language Model Pre-training☆26Apr 28, 2024Updated 2 years ago
- This is the implementation of our AAAI2024 paper: BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarizati…☆10Jul 13, 2024Updated 2 years ago
- [ICML 2021] "Efficient Lottery Ticket Finding: Less Data is More" by Zhenyu Zhang*, Xuxi Chen*, Tianlong Chen*, Zhangyang Wang☆26Dec 30, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304☆14Oct 11, 2022Updated 4 years ago
- ☆193Sep 26, 2024Updated 2 years ago
- ☆10Dec 18, 2023Updated 2 years ago
- zTT: Learning-based DVFS with Zero Thermal Throttling for Mobile Devices [MobiSys'21] - Artifact Evaluation☆31May 10, 2021Updated 5 years ago
- [ICLR 2024] "Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boosting"☆12Feb 22, 2024Updated 2 years ago
- ☆14Jul 26, 2024Updated 2 years ago
- [ACL 2025 Findings] Implicit Reasoning in Transformers is Reasoning through Shortcuts☆18Mar 11, 2025Updated last year
- ☆22Sep 29, 2024Updated 2 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆16Dec 9, 2023Updated 2 years ago
- Select a resolution / ratio for your SD3 latent.☆15Jan 20, 2026Updated 9 months ago
- Efficient and Online Dataset Growth Algorithm (with cleanness and diversity awareness) to deal with growing web data☆20Aug 6, 2024Updated 2 years ago
- ☆23Jan 24, 2023Updated 3 years ago
- Code Repository for the NeurIPS 2022 paper: "Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights".☆19Jul 10, 2024Updated 2 years ago
- The code of CIKM 2023 (Oral Presentation) : A Multi-Task Semantic Decomposition Framework with Task-specific Pre-training for Few-Shot NE…☆14Jul 19, 2024Updated 2 years ago
- [ICCV 2023] Label-Efficient Online Continual Object Detection in Streaming Video☆23Oct 22, 2026Updated 2 weeks ago
- The official implementation of the paper SimVP: Towards Simple yet Powerful Spatiotemporal Predictive learning.☆12Jan 2, 2024Updated 2 years ago
- ☆14Nov 20, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Transformer models for board games for KataGo☆24Sep 3, 2026Updated 2 months ago
- ☆107Mar 9, 2024Updated 2 years ago
- Encode chemical elements numerically and decode numerical representations of elements.☆11Updated this week
- Official PyTorch Implementation for Continual Learning and Private Unlearning☆19Jul 19, 2022Updated 4 years ago
- A library for squeakily cleaning and filtering language datasets.☆50Jul 10, 2023Updated 3 years ago
- Code Repository for the ICML 2024 paper: "Towards Scalable and Versatile Weight Space Learning".☆35Sep 9, 2024Updated 2 years ago
- PyTorch implementation of a 9-layer ResNet for CIFAR-10.☆11May 8, 2024Updated 2 years ago
- [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling☆80Apr 24, 2024Updated 2 years ago
- [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333☆1,184Jan 11, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Token Omission Via Attention☆130Oct 13, 2024Updated 2 years ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆21Jul 29, 2024Updated 2 years ago
- [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"☆451Oct 16, 2024Updated 2 years ago
- ☆10Aug 11, 2022Updated 4 years ago
- Experiments on the impact of depth in transformers and SSMs.☆48Oct 23, 2025Updated last year
- Imitation learning from multiple experts☆13Aug 29, 2022Updated 4 years ago
- [NeurIPS'22] Trap and Replace: Defending Backdoor Attacks by Trapping Them into an Easy-to-Replace Subnetwork. Haotao Wang, Junyuan Hong,…☆15Nov 27, 2023Updated 2 years ago