Alternatives and similar repositories for MODULoRA-Experiment

Users that are interested in MODULoRA-Experiment are comparing it to the libraries listed below

• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated last year
• Qualcomm-AI-research / lr-qat
  ☆39Updated 7 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆68Updated last week
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated last year
• facebookresearch / Ternary_Binary_Transformer
  ACL 2023
  ☆39Updated 2 years ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆152Updated last year
• NolanoOrg / SpectraSuite
  ☆48Updated 10 months ago
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 3 years ago
• tridao / flash-attention-wheels
  ☆49Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆44Updated 10 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆39Updated last year
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆68Updated 7 months ago
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆48Updated 10 months ago
• Dao-AILab / grouped-latent-attention
  ☆93Updated last week
• FasterDecoding / TEAL
  ☆129Updated 3 months ago
• ylsung / rsq
  Code for "RSQ: Learning from Important Tokens Leads to Better Quantized LLMs"
  ☆17Updated 2 weeks ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆108Updated 7 months ago
• ScalingIntelligence / CATS
  ☆25Updated 6 months ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆48Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆23Updated this week
• lightmatter-ai / INT-FP-QSim
  Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.
  ☆50Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆58Updated last year
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆70Updated last year
• utkarsh-dmx / project-resq
  ☆14Updated 2 months ago
• haochengxi / Train_Transformers_with_INT4
  ☆151Updated last year
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆121Updated last week
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆163Updated 10 months ago
• pprp / Pruner-Zero
  Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
  ☆82Updated 6 months ago