Alternatives and similar repositories for torchtrail

Users that are interested in torchtrail are comparing it to the libraries listed below

• cchan / tccl
  extensible collectives library in triton
  ☆86Updated last month
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆95Updated last year
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆91Updated 3 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆18Updated 4 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆55Updated this week
• kuterd / opal_ptx
  Experimental GPU language with meta-programming
  ☆22Updated 8 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 11 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆41Updated last year
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆173Updated last week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆205Updated 3 weeks ago
• tenstorrent / pytorch2.0_ttnn
  ⭐️ TTNN Compiler for PyTorch 2 ⭐️ It enables running PyTorch models on Tenstorrent hardware using torch.compile path
  ☆38Updated this week
• ColfaxResearch / cutlass-kernels
  ☆203Updated 10 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆73Updated 8 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆109Updated 10 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆301Updated this week
• lianakoleva / no-libtorch-compile
  ☆21Updated 2 months ago
• mayank31398 / cute-kernels
  A bunch of kernels that might make stuff slower 😉
  ☆40Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆267Updated this week
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆106Updated 7 months ago
• moritztng / grayskull-attention
  Attention in SRAM on Tenstorrent Grayskull
  ☆35Updated 10 months ago
• triton-lang / kernels
  ☆79Updated 6 months ago
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 3 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆158Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 10 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆57Updated 6 months ago
• manishucsd / py-codegen
  ☆16Updated 7 months ago
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆132Updated last year
• tenstorrent / tt-forge
  Tenstorrent's MLIR Based Compiler. We aim to enable developers to run AI on all configurations of Tenstorrent hardware, through an open-s…
  ☆48Updated this week
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆187Updated 11 months ago