groq / mlagility

Related projects ⓘ

Alternatives and complementary repositories for mlagility

• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆35Updated 6 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆50Updated this week
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆89Updated this week
• efeslab / fiddler
  Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆172Updated this week
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆68Updated 3 weeks ago
• ROCm / pyrsmi
  python package of rocm-smi-lib
  ☆18Updated last month
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆100Updated 3 weeks ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated last month
• fw-ai / llama-cuda-graph-example
  Example of applying CUDA graphs to LLaMA-v2
  ☆10Updated last year
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated this week
• mlc-ai / xgrammar
  Efficient, Flexible and Portable Structured Generation
  ☆53Updated this week
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆87Updated last month
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆145Updated this week
• Cornell-RelaxML / qtip
  ☆67Updated last week
• tonyzhang617 / nomad-dist
  ☆19Updated 8 months ago
• apple / ml-recurrent-drafter
  ☆99Updated last month
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆19Updated last week
• triton-lang / kernels
  ☆45Updated 2 weeks ago
• tridao / flash-attention-wheels
  ☆44Updated 11 months ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆148Updated last year
• gpu-mode / ring-attention
  ring-attention experiments
  ☆97Updated last month
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆86Updated 6 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆187Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆72Updated last month
• foundation-model-stack / fms-extras
  ☆20Updated 2 months ago
• moritztng / grayskull-attention
  Attention in SRAM on Tenstorrent Grayskull
  ☆29Updated 4 months ago
• mlc-ai / llm-perf-bench
  ☆114Updated 7 months ago