adam-maj / tiny-gpu

Related projects ⓘ

Alternatives and complementary repositories for tiny-gpu

• AnswerDotAI / gpu.cpp
  A lightweight library for portable low-level GPU computation using WebGPU.
  ☆3,746Updated last week
• karpathy / llm.c
  LLM training in simple, raw C/CUDA
  ☆24,356Updated last month
• gpu-mode / lectures
  Material for gpu-mode lectures
  ☆2,967Updated this week
• karpathy / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆3,580Updated 2 months ago
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆17,451Updated 3 months ago
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆4,418Updated this week
• ridgerchu / matmulfreellm
  Implementation for MatMul-free LM.
  ☆2,918Updated last week
• srush / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆9,861Updated 2 months ago
• dabochen / spreadsheet-is-all-you-need
  A nanoGPT pipeline packed in a spreadsheet
  ☆2,046Updated 4 months ago
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆1,643Updated this week
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,360Updated this week
• evilsocket / cake
  Distributed LLM and StableDiffusion inference for mobile, desktop and server.
  ☆2,610Updated 2 weeks ago
• naklecha / llama3-from-scratch
  llama3 implementation one matrix multiplication at a time
  ☆13,684Updated 5 months ago
• srush / Tensor-Puzzles
  Solve puzzles. Improve your pytorch.
  ☆3,267Updated 3 months ago
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,231Updated 3 months ago
• karpathy / micrograd
  A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
  ☆10,450Updated 3 months ago
• EurekaLabsAI / ngram
  The n-gram Language Model
  ☆1,337Updated 3 months ago
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆9,171Updated 4 months ago
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
  ☆7,955Updated 2 months ago
• pytorch / torchtitan
  A native PyTorch Library for large model training
  ☆2,586Updated last week
• google / gemma_pytorch
  The official PyTorch implementation of Google's Gemma models
  ☆5,284Updated 3 months ago
• pytorch / torchtune
  PyTorch native finetuning library
  ☆4,283Updated this week
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,661Updated 3 weeks ago
• google / gemma.cpp
  lightweight, standalone C++ inference engine for Google's Gemma models.
  ☆5,985Updated this week
• NVIDIA / warp
  A Python framework for high performance GPU simulation and graphics
  ☆4,234Updated this week
• jla524 / fromthetensor
  From the Tensor to Stable Diffusion, a rough outline for a 9 week course.
  ☆1,023Updated 6 months ago
• linkedin / Liger-Kernel
  Efficient Triton Kernels for LLM Training
  ☆3,401Updated this week
• mikex86 / LibreCuda
  ☆998Updated 3 weeks ago
• ictnlp / LLaMA-Omni
  LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…
  ☆2,538Updated last month
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆10,635Updated this week