transmuteAI / trailmet
Transmute AI Lab Model Efficiency Toolkit
☆19Updated last year
Related projects ⓘ
Alternatives and complementary repositories for trailmet
- Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs☆33Updated 2 weeks ago
- Official implementation of ECCV24 paper: POA☆24Updated 3 months ago
- ☆40Updated 6 months ago
- Official code for the paper "Attention as a Hypernetwork"☆23Updated 4 months ago
- Implementation of the paper: "BRAVE : Broadening the visual encoding of vision-language models"☆21Updated this week
- This repository contains code for the MicroAdam paper.☆12Updated 4 months ago
- Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"☆50Updated last month
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆49Updated 7 months ago
- Implementation of a modular, high-performance, and simplistic mamba for high-speed applications☆33Updated last week
- Prune transformer layers☆64Updated 5 months ago
- Lottery Ticket Adaptation☆36Updated last month
- QuIP quantization☆46Updated 7 months ago
- ☆34Updated 9 months ago
- Collection of autoregressive model implementation☆66Updated last week
- ☆29Updated this week
- ☆21Updated last week
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆91Updated last month
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆27Updated 2 weeks ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆18Updated last month
- ☆27Updated this week
- Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks☆30Updated 4 months ago
- Contains materials for my talk "You don't know TensorFlow".☆9Updated last year
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆49Updated 2 months ago
- Here we will test various linear attention designs.☆56Updated 6 months ago
- Repository for CPU Kernel Generation for LLM Inference☆24Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆46Updated 2 months ago
- ☆49Updated 8 months ago
- ☆42Updated 11 months ago
- Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…☆18Updated last year
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆43Updated 3 months ago