Alternatives and similar repositories for torch_cgx:

Users that are interested in torch_cgx are comparing it to the libraries listed below

• Youhe-Jiang / IJCAI2023-OptimalShardedDataParallel
  [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…
  ☆51Updated last year
• triton-lang / kernels
  ☆67Updated 3 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆83Updated 4 months ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆143Updated 8 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆238Updated this week
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆64Updated 5 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆105Updated this week
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆229Updated this week
• DS3Lab / CocktailSGD
  ☆26Updated last year
• yifuwang / symm-mem-recipes
  ☆44Updated last month
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆33Updated 6 months ago
• thu-ml / Jetfire-INT8Training
  ☆35Updated 7 months ago
• lightmatter-ai / INT-FP-QSim
  Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.
  ☆47Updated last year
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆225Updated this week
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆102Updated 4 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆168Updated last month
• ScalingIntelligence / CATS
  ☆23Updated 3 months ago
• spcl / substation
  Research and development for optimizing transformers
  ☆125Updated 4 years ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆77Updated this week
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆117Updated 6 months ago
• Cornell-RelaxML / qtip
  ☆107Updated last month
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆64Updated 3 months ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆221Updated 6 months ago
• jy-yuan / KIVI
  [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
  ☆272Updated last month
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆105Updated 2 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆199Updated last year
• microsoft / TileFusion
  TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.
  ☆56Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆180Updated this week
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆295Updated 7 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 11 months ago