Alternatives and similar repositories for easy_mindspore_bk

Users that are interested in easy_mindspore_bk are comparing it to the libraries listed below

• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆102Updated 2 years ago
• han-shi / SparseBERT
  ☆13Updated 3 years ago
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆90Updated 2 years ago
• BIGBALLON / distribuuuu
  The pure and clear PyTorch Distributed Training Framework.
  ☆274Updated last year
• bojone / tiger
  A Tight-fisted Optimizer
  ☆50Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆87Updated 2 years ago
• ICT-ANS / StarLight
  ☆61Updated last year
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆39Updated last year
• lvyufeng / cybertron-ai
  mindspore implementation of transformers
  ☆68Updated 2 years ago
• CASIA-LMC-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆63Updated last year
• princeton-nlp / CoFiPruning
  [ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408
  ☆198Updated 2 years ago
• HFAiLab / pytorch_distributed
  The test of different distributed-training methods on High-Flyer AIHPC
  ☆26Updated 3 years ago
• mdy666 / Qwen-Native-Sparse-Attention
  qwen-nsa
  ☆84Updated 2 months ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 3 years ago
• L1aoXingyu / llm-infer-bench
  ☆12Updated 2 years ago
• Ascend / AscendSpeed
  ☆79Updated last year
• fkodom / grouped-query-attention-pytorch
  (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …
  ☆185Updated last year
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆147Updated 2 months ago
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆64Updated 2 years ago
• zyxxmu / Bi-Mask
  Pytorch implementation of our paper accepted by ICML 2023 -- "Bi-directional Masks for Efficient N:M Sparse Training"
  ☆12Updated 2 years ago
• ruikangliu / IntactKV
  [ACL 2024] Official PyTorch implementation of "IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact"
  ☆48Updated last year
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆49Updated 3 years ago
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆50Updated 2 years ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆100Updated last year
• TianjinYellow / StableSPAM
  ☆27Updated 8 months ago
• OpenNLPLab / cosFormer
  [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
  ☆196Updated 3 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆199Updated 2 years ago
• Spico197 / watchmen
  😎 A simple and easy-to-use toolkit for GPU scheduling.
  ☆45Updated 7 months ago
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆30Updated last year