Alternatives and similar repositories for transformer_bcq:

Users that are interested in transformer_bcq are comparing it to the libraries listed below

• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 2 months ago
• topal-team / rockmate
  ☆35Updated 3 months ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆151Updated 9 months ago
• tridao / flash-attention-wheels
  ☆46Updated last year
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆116Updated last year
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆43Updated 7 months ago
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆89Updated last year
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆92Updated last year
• mgmalek / efficient_cross_entropy
  ☆94Updated 9 months ago
• vedantroy / gpu_kernels
  ☆25Updated last year
• HanGuo97 / lq-lora
  ☆125Updated last year
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆97Updated 2 months ago
• nbasyl / LLM-FP4
  The official implementation of the EMNLP 2023 paper LLM-FP4
  ☆187Updated last year
• sustcsonglin / mamba-triton
  ☆47Updated last year
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆91Updated 3 months ago
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆192Updated last month
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 11 months ago
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆58Updated last year
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆67Updated 6 months ago
• stanford-futuredata / stk
  ☆100Updated 6 months ago
• FasterDecoding / TEAL
  ☆115Updated 3 weeks ago
• ScalingIntelligence / CATS
  ☆23Updated 4 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆68Updated 4 months ago
• insuhan / hyper-attn
  ☆80Updated last year
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆20Updated 3 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆16Updated 2 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆201Updated last year
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆56Updated 5 months ago