The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
☆44May 10, 2023Updated 3 years ago
Alternatives and similar repositories for Cuttlefish
Users that are interested in Cuttlefish are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR2023] Practical Network Acceleration with Tiny Sets☆13Jul 28, 2023Updated 2 years ago
- NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference☆69Dec 9, 2024Updated last year
- ☆65Oct 17, 2023Updated 2 years ago
- ☆12Dec 26, 2024Updated last year
- PyTorch implementation of Language model compression with weighted low-rank factorization☆14Jun 28, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)☆35Aug 6, 2023Updated 2 years ago
- ☆11May 24, 2024Updated 2 years ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 2 years ago
- Provides the code for the paper "EBPC: Extended Bit-Plane Compression for Deep Neural Network Inference and Training Accelerators" by Luk…☆18Oct 6, 2019Updated 6 years ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Oct 9, 2022Updated 3 years ago
- Trying to deconstruct RWKV in understandable terms☆14May 6, 2023Updated 3 years ago
- ☆16Dec 9, 2023Updated 2 years ago
- ☆16Oct 4, 2024Updated last year
- Some materials and sample source for RV32 OS projects.☆22May 31, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆13Jun 3, 2023Updated 3 years ago
- [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer☆30Dec 6, 2023Updated 2 years ago
- Kinetics: Rethinking Test-Time Scaling Laws☆87Jul 11, 2025Updated 11 months ago
- [ICLR 2025] RaSA: Rank-Sharing Low-Rank Adaptation☆10May 19, 2025Updated last year
- Training a reward model for RLHF using RWKV.☆15Jun 5, 2023Updated 3 years ago
- AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION☆16Oct 27, 2023Updated 2 years ago
- Easily serialize dataclasses to and from tensors (PyTorch, NumPy)☆18Apr 10, 2021Updated 5 years ago
- This is the official implmentation of Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data (IJCAI 2022 Long …☆11Mar 8, 2023Updated 3 years ago
- Code for ScaleFL☆34Dec 11, 2025Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆47Oct 11, 2023Updated 2 years ago
- This is a repository for the implementation of the paper "Green, Quantized Federated Learning over Wireless Networks: An Energy-Efficient…☆14Jul 1, 2023Updated 3 years ago
- ☆10Nov 27, 2019Updated 6 years ago
- Loop Nest - Linear algebra compiler and code generator.☆20Oct 22, 2022Updated 3 years ago
- Official PyTorch implementation of CD-MOE☆12Mar 18, 2026Updated 3 months ago
- Official implementation of ECCV24 paper: POA☆24Aug 8, 2024Updated last year
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆49Mar 29, 2024Updated 2 years ago
- Official code for the paper "Attention as a Hypernetwork"☆57Feb 24, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Node.js implementation binding for the RWKV.cpp module