Alternatives and similar repositories for llm.c

Users that are interested in llm.c are comparing it to the libraries listed below

• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆351Updated this week
• salykova / sgemm.cu
  High-Performance FP32 GEMM on CUDA devices
  ☆117Updated last year
• HazyResearch / HipKittens
  Fast and Furious AMD Kernels
  ☆348Updated 2 weeks ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆93Updated this week
• LaurieWired / BenchmarkCustomPTX
  Custom PTX Instruction Benchmark
  ☆138Updated 11 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆99Updated 8 months ago
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆152Updated last year
• seb-v / fp32_sgemm_amd
  Super fast FP32 matrix multiplication on RDNA3
  ☆82Updated 10 months ago
• apple / ml-recurrent-drafter
  ☆219Updated last year
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆112Updated last year
• gpu-mode / popcorn-cli
  ☆95Updated this week
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆427Updated last week
• gpu-mode / reference-kernels
  Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
  ☆201Updated this week
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆71Updated this week
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆387Updated 9 months ago
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 10 months ago
• kuterd / nv_isa_solver
  Nvidia Instruction Set Specification Generator
  ☆311Updated last year
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆88Updated last week
• KevlarKanou / rwkv7.c
  Inference RWKV v7 in pure C.
  ☆44Updated 3 months ago
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆200Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆286Updated this week
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆243Updated last year
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆214Updated this week
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆113Updated this week
• IST-DASLab / llmq
  Quantized LLM training in pure CUDA/C++.
  ☆238Updated 2 weeks ago
• moritztng / grayskull-attention
  Attention in SRAM on Tenstorrent Grayskull
  ☆40Updated last year
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆97Updated 3 months ago
• tenstorrent / tt-buda
  Tenstorrent TT-BUDA Repository
  ☆314Updated 10 months ago
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆251Updated 9 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆26Updated 6 months ago