Alternatives and similar repositories for tinyBLAS

Users that are interested in tinyBLAS are comparing it to the libraries listed below

• Verdagon / Anima
  33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
  ☆13Updated last year
• blackhole89 / autopen
  Editor with LLM generation tree exploration
  ☆68Updated 4 months ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆47Updated 3 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• cjpais / whisperfile
  ☆57Updated 10 months ago
• Const-me / Cgml
  GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.
  ☆58Updated last year
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆128Updated 11 months ago
• geohot / tt-tiny
  tiny code to access tenstorrent blackhole
  ☆52Updated last month
• nirw4nna / dsc
  Tensor library & inference framework for machine learning
  ☆97Updated this week
• qianfei11 / ShadowyCompression
  A JPEG Image Compression Service using Part Homomorphic Encryption.
  ☆31Updated 3 months ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆107Updated last month
• slightknack / difflogic
  Train neural networks that distill into logic circuits, using JAX
  ☆58Updated 2 weeks ago
• KevlarKanou / rwkv7.c
  Inference RWKV v7 in pure C.
  ☆34Updated 2 months ago
• mikepapadim / llama-shepherd-cli
  A CLI to manage install and configure llama inference implemenation in multiple languages
  ☆67Updated last year
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆25Updated 5 months ago
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆49Updated 4 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• spirobel / bunny-llama
  iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh
  ☆49Updated last year
• ryao / llama3.c
  A fork of llama3.c used to do some R&D on inferencing
  ☆22Updated 6 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆76Updated 9 months ago
• devidw / inferit
  Visual inference exploration & experimentation playground
  ☆94Updated 6 months ago
• LeetArxiv / Finite-Field-Assembly
  The Finite Field Assembly Programming Language
  ☆37Updated last month
• okuvshynov / llama_duo
  asynchronous/distributed speculative evaluation for llama3
  ☆39Updated 10 months ago
• Dicklesworthstone / llm_introspective_compression_and_metacognition
  A novel approach for transformer model introspection that enables saving, compressing, and manipulating internal thought states for advan…
  ☆20Updated 2 months ago
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆21Updated last year
• jmward01 / lmplay
  A playground to make it easy to try crazy things
  ☆33Updated last week
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated last week
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year