Alternatives and similar repositories for tinyBLAS:

Users that are interested in tinyBLAS are comparing it to the libraries listed below

• perk11 / large-model-proxy
  Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…
  ☆49Updated 3 months ago
• cjpais / whisperfile
  ☆53Updated 5 months ago
• jameswdelancey / llama3.c
  A faithful clone of Karpathy's llama2.c (one file inference, zero dependency) but fully functional with LLaMA 3 8B base and instruct mode…
  ☆113Updated 6 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆133Updated this week
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆104Updated this week
• spirobel / bunny-llama
  iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh
  ☆47Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated 11 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆79Updated 5 months ago
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆44Updated 4 months ago
• Verdagon / Anima
  33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
  ☆13Updated 8 months ago
• exo-explore / evML
  Resources regarding evML (edge verified machine learning)
  ☆13Updated 3 weeks ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆43Updated last week
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆41Updated this week
• ggerganov / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆31Updated last year
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 7 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆127Updated 6 months ago
• slashml / awesome-finetuning
  ☆27Updated 5 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆40Updated 2 weeks ago
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆27Updated 10 months ago
• lechmazur / writing
  This benchmark tests how well LLMs incorporate a set of 10 mandatory story elements (characters, objects, core concepts, attributes, moti…
  ☆35Updated last week
• cognitivecomputations / kraken
  ☆65Updated 8 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆51Updated last year
• remyxai / LocalMentor
  Local Startup Advisor Chatbot
  ☆30Updated last year
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆57Updated this week
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.
  ☆15Updated 2 months ago
• Const-me / Cgml
  GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.
  ☆53Updated last year
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆67Updated 4 months ago
• spectral-compute / scale-examples
  ☆53Updated 6 months ago
• mikepapadim / llama-shepherd-cli
  A CLI to manage install and configure llama inference implemenation in multiple languages
  ☆65Updated last year