Alternatives and similar repositories for Transformer-attention

Users that are interested in Transformer-attention are comparing it to the libraries listed below

• LeapLabTHU / Deep-Incubation
  Code release for Deep Incubation (https://arxiv.org/abs/2212.04129)
  ☆90Updated 2 years ago
• LeapLabTHU / LASNet
  [NeurIPS 2022] Latency-aware Spatial-wise Dynamic Networks
  ☆24Updated 2 years ago
• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers
  ☆105Updated 10 months ago
• ZO-Bench / ZO-LLM
  [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆111Updated 3 months ago
• TRI-ML / vlm-evaluation
  VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning
  ☆128Updated last year
• silicx / GoldFromOres-BiLP
  Preview code of ECCV'24 paper "Distill Gold from Massive Ores" (BiLP)
  ☆25Updated last year
• ggjy / DeLVM
  ☆119Updated last year
• NUS-HPC-AI-Lab / DATM
  ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
  ☆102Updated last year
• drivetosouth / SafeDialBench-Dataset
  Official github repo for SafeDialBench, a comprehensive multi-turn dialogue benchmark to evaluate LLMs' safety.
  ☆35Updated 5 months ago
• Mi-Peng / Sparse-Sharpness-Aware-Minimization
  [NeurIPS 2022] Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach -- Official Implementation
  ☆45Updated 2 years ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆137Updated 3 months ago
• LeapLabTHU / L2W-DEN
  [ECCV 2022] Learning to Weight Samples for Dynamic Early-exiting Networks
  ☆36Updated 2 years ago
• zhyang2226 / OPA-DPO
  [CVPR 2025 (Oral)] Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Key
  ☆84Updated last month
• OpenGVLab / DiffRate
  [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…
  ☆101Updated 2 years ago
• szxiangjn / world-model-for-language-model
  ☆131Updated last year
• LiaoMengqi / HMoRA
  [ ICLR 2025 ] Making LLMs More Effective with Hierarchical Mixture of LoRA Experts
  ☆18Updated 3 weeks ago
• foundation-multimodal-models / ConBench
  [NeurIPS'24] Official implementation of paper "Unveiling the Tapestry of Consistency in Large Vision-Language Models".
  ☆38Updated last year
• LeapLabTHU / LAUDNet
  [IEEE TPAMI] Latency-aware Unified Dynamic Networks for Efficient Image Recognition
  ☆52Updated 7 months ago
• RyanWangZf / PAC-Bayes-IB
  Official repo for PAC-Bayes Information Bottleneck. ICLR 2022.
  ☆50Updated 3 years ago
• LeapLabTHU / CheckpointKD
  ☆27Updated 3 years ago
• maple-research-lab / LLaDOU
  Implementation of "Reinforcing the Diffusion Chain of Lateral Thought with Diffusion Language Models"
  ☆57Updated 3 months ago
• yueyang130 / SEEM
  Official code of paper Understanding, Predicting and Better Resolving Q-Value Divergence in Offline-RL
  ☆23Updated 2 years ago
• ylsung / ECoFLaP
  Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)
  ☆20Updated last year
• dongzelian / SSF
  [NeurIPS'22] This is an official implementation for "Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning".
  ☆188Updated 2 years ago
• ZhangYuanhan-AI / NOAH
  [TPAMI] Searching prompt modules for parameter-efficient transfer learning.
  ☆235Updated last year
• wutaiqiang / MoSLoRA
  ☆120Updated last year
• LR32768 / DL_theory_exp
  ☆16Updated last year
• yfzhang114 / LLaVA-Align
  [ACM Multimedia 2025] This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual…
  ☆82Updated 8 months ago
• WayneTomas / VPP-LLaVA
  [TMM 2025] This is the official Pytorch code for our paper "Visual Position Prompt for MLLM based Visual Grounding".
  ☆26Updated 3 months ago
• THUNLP-MT / ModelCompose
  Official code for our paper "Model Composition for Multimodal Large Language Models" (ACL 2024)
  ☆30Updated 9 months ago