Alternatives and similar repositories for tinyBLAS:

Users that are interested in tinyBLAS are comparing it to the libraries listed below

• Verdagon / Anima
  33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
  ☆13Updated 11 months ago
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆66Updated 2 months ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆47Updated last month
• cjpais / whisperfile
  ☆54Updated 8 months ago
• PavleMiha / mlgarden
  ☆23Updated 5 months ago
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆125Updated 9 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆56Updated 2 months ago
• LeetArxiv / Finite-Field-Assembly
  The Finite Field Assembly Programming Language
  ☆36Updated 2 weeks ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• deepgrove-ai / Bonsai
  ☆19Updated last month
• fraware / leanverifier
  Framework for specifying and proving properties—such as robustness, fairness, and interpretability—of machine learning models using Lean …
  ☆58Updated last month
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 10 months ago
• qianfei11 / ShadowyCompression
  A JPEG Image Compression Service using Part Homomorphic Encryption.
  ☆30Updated last month
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 6 months ago
• usefulsensors / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆96Updated 6 months ago
• GPUOpen-LibrariesAndSDKs / Schola
  Schola is a plugin for enabling Reinforcement Learning (RL) in Unreal Engine. It provides tools to help developers create environments, d…
  ☆34Updated 3 weeks ago
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated 7 months ago
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆27Updated 3 weeks ago
• Slackadays / Chata
  Make DSP Great Again. The Chata programming language!
  ☆63Updated last month
• Dicklesworthstone / llm_introspective_compression_and_metacognition
  A novel approach for transformer model introspection that enables saving, compressing, and manipulating internal thought states for advan…
  ☆18Updated 3 weeks ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• inductor-hq / llm-toolkit
  Open-source LLM app starter templates – easily get started with a systematic, rapid workflow for taking an LLM app from prototype to prod…
  ☆10Updated 6 months ago
• djgish485 / ballistic-ai
  Prompt-based software development
  ☆23Updated 8 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆187Updated last year
• guidance-ai / llgtrt
  TensorRT-LLM server with Structured Outputs (JSON) built with Rust
  ☆49Updated 3 weeks ago
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆46Updated 2 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆132Updated last week
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆67Updated 6 months ago
• golf-lang / golf
  Golf is a programming language, framework and application server for high-performance web services and web applications, with focus on …
  ☆44Updated this week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆71Updated 2 months ago