Alternatives and similar repositories for LibreCuda:

Users that are interested in LibreCuda are comparing it to the libraries listed below

• tinygrad / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆1,063Updated 3 months ago
• slashml / amd_inference
  Docker-based inference engine for AMD GPUs
  ☆230Updated 5 months ago
• ashvardanian / SimSIMD
  Up to 200x Faster Dot Products & Similarity Metrics — for Python, Rust, C, JS, and Swift, supporting f64, f32, f16 real & complex, i8, an…
  ☆1,294Updated last month
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆734Updated last week
• AMD-AIG-AIMA / AMD-LLM
  ☆186Updated 7 months ago
• tinygrad / 7900xtx
  ☆438Updated 2 weeks ago
• mlecauchois / micrograd-cuda
  ☆242Updated last year
• ggml-org / llama.vim
  Vim plugin for LLM-assisted code/text completion
  ☆1,304Updated 2 weeks ago
• kuterd / nv_isa_solver
  Nvidia Instruction Set Specification Generator
  ☆253Updated 8 months ago
• salykova / matmul.c
  Multi-Threaded FP32 Matrix Multiplication on x86 CPUs
  ☆342Updated last month
• trevorpogue / algebraic-nnhw
  Algebraic enhancements for GEMM & AI accelerators
  ☆274Updated last month
• HazyResearch / ThunderKittens
  Tile primitives for speedy kernels
  ☆2,184Updated this week
• kevmo314 / scuda
  SCUDA is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
  ☆1,682Updated 2 weeks ago
• lights0123 / hipscript
  Online compiler for HIP and NVIDIA® CUDA® code to WebGPU
  ☆142Updated 2 months ago
• tzakharko / m4-sme-exploration
  Exploring the scalable matrix extension of the Apple M4 processor
  ☆169Updated 4 months ago
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,431Updated this week
• corsix / amx
  Apple AMX Instruction Set
  ☆1,059Updated 3 months ago
• robjinman / richard
  Richard is gaining power
  ☆184Updated 4 months ago
• likejazz / llama3.np
  llama3.np is a pure NumPy implementation for Llama 3 model.
  ☆977Updated 9 months ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆262Updated 2 months ago
• b4rtaz / distributed-llama
  Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆1,993Updated this week
• google-ai-edge / model-explorer
  A modern model graph visualizer and debugger
  ☆1,152Updated this week
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 8 months ago
• ROCm / HIPIFY
  HIPIFY: Convert CUDA to Portable C++ Code
  ☆565Updated this week
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆604Updated last week
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆274Updated 7 months ago
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆980Updated 5 months ago
• zml / zml
  Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild
  ☆2,173Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆222Updated this week
• abeleinin / Metal-Puzzles
  Solve Puzzles. Learn Metal 🤘
  ☆544Updated 6 months ago