Alternatives and similar repositories for mlagility:

Users that are interested in mlagility are comparing it to the libraries listed below

• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆40Updated last week
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆59Updated 2 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 11 months ago
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆87Updated 2 months ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆108Updated 3 weeks ago
• moritztng / grayskull-attention
  Attention in SRAM on Tenstorrent Grayskull
  ☆32Updated 8 months ago
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 3 years ago
• fw-ai / llama-cuda-graph-example
  Example of applying CUDA graphs to LLaMA-v2
  ☆12Updated last year
• ROCm / TransformerEngine
  ☆25Updated this week
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆25Updated this week
• deepspeedai / DeepSpeed-Kernels
  ☆63Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• pytorch / tlparse
  TORCH_LOGS parser for PT2
  ☆36Updated this week
• vedantroy / gpu_kernels
  ☆25Updated last year
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆91Updated this week
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆104Updated 5 months ago
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆63Updated last week
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆35Updated this week
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 5 months ago
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆92Updated 10 months ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆152Updated last year
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆60Updated last week
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• foundation-model-stack / fms-extras
  ☆24Updated 6 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated last week
• Deep-Learning-Profiling-Tools / triton-samples
  ☆13Updated 3 weeks ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆17Updated 2 months ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 3 months ago