Alternatives and similar repositories for StreamAttn

Users that are interested in StreamAttn are comparing it to the libraries listed below

• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆145Updated last year
• PrimeIntellect-ai / pi-quant
  SIMD quantization kernels
  ☆89Updated last month
• IST-DASLab / llmq
  Quantized LLM training in pure CUDA/C++.
  ☆209Updated this week
• nreHieW / r-nn
  Tensor library with autograd using only Rust's standard library
  ☆70Updated last year
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 7 months ago
• apoorvnandan / lilgrad
  pytorch from scratch in pure C/CUDA and python
  ☆41Updated last year
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆133Updated last month
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆139Updated last year
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆72Updated 6 months ago
• snowclipsed / moondream-zig
  moondream in zig.
  ☆76Updated 5 months ago
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆68Updated 5 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆107Updated 7 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• kanpuriyanawab / picograd
  Rust Implementation of micrograd
  ☆53Updated last year
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last month
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated last year
• okarthikb / state-space-models
  ☆28Updated last year
• Laz4rz / ziglings
  Extensive introductory writeup on Zig language functionalities
  ☆10Updated last year
• Figura-Labs-Inc / telegraf_nv_export
  Ultra low overhead NVIDIA GPU telemetry plugin for telegraf with memory temperature readings.
  ☆63Updated last year
• smolorg / smoltropix
  MLX port for xjdr's entropix sampler (mimics jax implementation)
  ☆62Updated 11 months ago
• N8python / mlx-pretrain
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆84Updated 2 months ago
• doomslide / attention-graph
  A graph visualization of attention
  ☆57Updated 5 months ago
• N8python / n8loom
  A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.
  ☆72Updated 8 months ago
• haraschax / nograd
  Gradient descent is cool and all, but what if we could delete it?
  ☆104Updated 2 months ago
• xjdr-alt / muzero_sketch
  ☆40Updated last year
• PrimeIntellect-ai / protocol
  peer-to-peer compute and intelligence network that enables decentralized AI development at scale
  ☆127Updated 3 months ago
• astledsa / Deep-Learning-C
  An implement of deep learning framework and models in C
  ☆48Updated 6 months ago
• Snektron / gpumode-amd-fp8-mm
  My submission for the GPUMODE/AMD fp8 mm challenge
  ☆29Updated 4 months ago
• kuterd / opal_ptx
  Experimental GPU language with meta-programming
  ☆23Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆95Updated 5 months ago