groq / mlagility

Related projects ⓘ

Alternatives and complementary repositories for mlagility

• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆34Updated 5 months ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 3 weeks ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆57Updated this week
• ROCm / pyrsmi
  python package of rocm-smi-lib
  ☆18Updated last month
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆46Updated this week
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆99Updated last week
• moritztng / grayskull-attention
  Attention in SRAM on Tenstorrent Grayskull
  ☆29Updated 3 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• intel / intel-extension-for-openxla
  ☆39Updated last month
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆19Updated last week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆63Updated last week
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆133Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆152Updated this week
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated last month
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆146Updated 11 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆159Updated last week
• triton-lang / kernels
  ☆43Updated this week
• Jokeren / triton-samples
  ☆23Updated 2 months ago
• efeslab / fiddler
  Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆170Updated last week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆95Updated 3 weeks ago
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated last week
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆86Updated 6 months ago
• fw-ai / llama-cuda-graph-example
  Example of applying CUDA graphs to LLaMA-v2
  ☆10Updated last year
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆53Updated this week
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆47Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆140Updated this week
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆25Updated last week
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 3 months ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆196Updated last week