Alternatives and similar repositories for easy_mindspore_bk:

Users that are interested in easy_mindspore_bk are comparing it to the libraries listed below

• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated 2 years ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆51Updated 3 months ago
• nbasyl / OFQ
  The official implementation of the ICML 2023 paper OFQ-ViT
  ☆30Updated last year
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆94Updated last year
• zyxxmu / Bi-Mask
  Pytorch implementation of our paper accepted by ICML 2023 -- "Bi-directional Masks for Efficient N:M Sparse Training"
  ☆12Updated last year
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆45Updated last year
• han-shi / SparseBERT
  ☆13Updated 2 years ago
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆47Updated last year
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆35Updated last year
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆82Updated 2 years ago
• cat538 / SKVQ
  SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
  ☆19Updated 6 months ago
• ruikangliu / IntactKV
  Official PyTorch implementation of "IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact"
  ☆43Updated 10 months ago
• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• PeiyanFlying / SPViT
  ☆46Updated 7 months ago
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆52Updated last year
• lvyufeng / Cybertron
  mindspore implementation of transformers
  ☆66Updated 2 years ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆46Updated this week
• Richar-Du / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆18Updated last month
• NonvolatileMemory / flash_tree_attn
  ☆19Updated 3 months ago
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆26Updated last year
• RangiLyu / llama.mmengine
  Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!
  ☆40Updated 2 years ago
• DD-DuDa / BitDistiller
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
  ☆108Updated 10 months ago
• LKJacky / Differentiable-Model-Scaling
  This is the official repo for "Differentiable Model Scaling using Differentiable Topk"
  ☆9Updated 10 months ago
• mdy666 / mdy_triton
  ☆111Updated this week
• YifanXu74 / Evo-ViT
  Official implement of Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer
  ☆71Updated 2 years ago
• AboveParadise / LLMCBench
  ☆21Updated 4 months ago
• HuangOwen / QAT-ACS
  [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"
  ☆30Updated 7 months ago
• thu-coai / MiniPLM
  [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models
  ☆34Updated 4 months ago
• VITA-Group / SViTE
  [NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang…
  ☆89Updated last year
• shawnricecake / search-llm
  [NeurIPS 2024] Search for Efficient LLMs
  ☆12Updated 2 months ago