SprocketLab / sparse_matrix_fine_tuning
Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"
☆17Updated last week
Alternatives and similar repositories for sparse_matrix_fine_tuning:
Users that are interested in sparse_matrix_fine_tuning are comparing it to the libraries listed below
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆30Updated 6 months ago
- ☆12Updated 2 weeks ago
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated 9 months ago
- Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆25Updated last week
- Representing Rule-based Chatbots with Transformers☆19Updated 6 months ago
- Here we will test various linear attention designs.☆58Updated 8 months ago
- ☆15Updated 5 months ago
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆40Updated 9 months ago
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆33Updated last year
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆33Updated 6 months ago
- ☆28Updated last month
- Official implementation of ECCV24 paper: POA☆24Updated 5 months ago
- Official code for the paper "Attention as a Hypernetwork"☆23Updated 6 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆52Updated 4 months ago
- Codebase for Instruction Following without Instruction Tuning☆33Updated 3 months ago
- ☆41Updated 2 weeks ago
- DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆71Updated last month
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆40Updated 6 months ago
- Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs☆22Updated 3 months ago
- This repository contains code for the MicroAdam paper.☆15Updated last month
- FocusLLM: Scaling LLM’s Context by Parallel Decoding☆34Updated last month
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆44Updated last year
- PyTorch implementation of StableMask (ICML'24)☆12Updated 6 months ago
- ☆15Updated last week
- ☆24Updated 5 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆23Updated 4 months ago
- Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"☆35Updated last year
- Using FlexAttention to compute attention with different masking patterns☆40Updated 3 months ago
- Minimal Implementation of Visual Autoregressive Modelling (VAR)☆23Updated last week