Alternatives and similar repositories for LOZO

Users that are interested in LOZO are comparing it to the libraries listed below

• thu-ml / Adaptive-Sparse-Trainer
  Official implementation for "Pruning Large Language Models with Semi-Structural Adaptive Sparse Training" (AAAI 2025)
  ☆11Updated 5 months ago
• hyhuang00 / moe_inference
  Code Repository for the NeurIPS 2024 Paper "Toward Efficient Inference for Mixture of Experts".
  ☆16Updated 7 months ago
• TUDa-HWAI / Basis_Sharing
  ☆10Updated 8 months ago
• UNITES-Lab / HEXA-MoE
  Official code for the paper "HEXA-MoE: Efficient and Heterogeneous-Aware MoE Acceleration with Zero Computation Redundancy"
  ☆14Updated 3 months ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆104Updated 11 months ago
• thu-ml / Jetfire-INT8Training
  ☆49Updated 10 months ago
• PKU-SEC-Lab / AdapMoE
  Code release for AdapMoE accepted by ICCAD 2024
  ☆26Updated last month
• imagination-research / EEP
  Efficient Expert Pruning for Sparse Mixture-of-Experts Language Models: Enhancing Performance and Reducing Inference Costs
  ☆16Updated 5 months ago
• fmfi-compbio / admm-pruning
  ☆28Updated 10 months ago
• ACA-Lab-SJTU / token-ring
  ☆10Updated 5 months ago
• mit-han-lab / x-attention
  XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆160Updated this week
• OpenSparseLLMs / Linear-MoE
  ☆95Updated 2 weeks ago
• NVlabs / Fast-dLLM
  ☆144Updated this week
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆222Updated 3 months ago
• ruikangliu / Quantized-Reasoning-Models
  Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"
  ☆34Updated last week
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆195Updated last year
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆94Updated 2 months ago
• PingchengDong / GQA-LUT
  The official implementation of the DAC 2024 paper GQA-LUT
  ☆18Updated 5 months ago
• yuezhouhu / 2by4-pretrain
  Efficient 2:4 sparse training algorithms and implementations
  ☆54Updated 5 months ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆32Updated last year
• UNITES-Lab / moe-quantization
  Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"
  ☆20Updated 11 months ago
• GATECH-EIC / Edge-LLM
  [DAC 2024] EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive La…
  ☆56Updated 11 months ago
• amazon-science / mezo_svrg
  Code the ICML 2024 paper: "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"
  ☆11Updated 11 months ago
• thu-nics / qllm-eval
  Code Repository of Evaluating Quantized Large Language Models
  ☆123Updated 8 months ago
• cjf00000 / StatQuant
  code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"
  ☆28Updated 4 years ago
• VITA-Group / llm-kick
  [ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
  ☆24Updated last month
• LiuXiaoxuanPKU / OSD
  ☆50Updated 6 months ago
• Aaronhuang-778 / SliM-LLM
  [ICML 2025] SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆31Updated 9 months ago
• Qualcomm-AI-research / gptvq
  ☆30Updated last year
• NoakLiu / FastCache-xDiT
  FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]
  ☆21Updated last week