Alternatives and similar repositories for llama4micro

Users that are interested in llama4micro are comparing it to the libraries listed below

• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆567Updated last year
• OneInterface / realtime-bakllava
  llama.cpp with BakLLaVA model describes what does it see
  ☆383Updated last year
• microsoft / Llama-2-Onnx
  ☆1,025Updated last year
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆499Updated 9 months ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆309Updated last year
• pranavjad / mlx-gpt2
  gpt-2 from scratch in mlx
  ☆387Updated 11 months ago
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆287Updated last year
• noahfarr / rlx
  A reinforcement learning framework based on MLX.
  ☆233Updated 3 months ago
• sumo43 / loopvlm
  run paligemma in real time
  ☆131Updated last year
• ash-01xor / bpe.c
  Simple Byte pair Encoding mechanism used for tokenization process . written purely in C
  ☆132Updated 6 months ago
• evanmiller / LLM-Reading-List
  LLM papers I'm reading, mostly on inference and model compression
  ☆730Updated last year
• adamcohenhillel / LLMs-Cheatsheet
  Instructions on how to run LLMs on Raspberry PI
  ☆207Updated 10 months ago
• Cerebras / gigaGPT
  a small code base for training large models
  ☆300Updated last month
• tysam-code / hlb-gpt
  Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…
  ☆345Updated 10 months ago
• trholding / llama2.c
  Llama 2 Everywhere (L2E)
  ☆1,517Updated 4 months ago
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆94Updated last week
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆713Updated last year
• mlecauchois / micrograd-cuda
  ☆243Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆179Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆188Updated 4 months ago
• usefulsensors / useful-transformers
  Efficient Inference of Transformer models
  ☆433Updated 10 months ago
• google-ai-edge / model-explorer
  A modern model graph visualizer and debugger
  ☆1,212Updated last week
• mit-han-lab / TinyChatEngine
  TinyChatEngine: On-Device LLM Inference Library
  ☆854Updated 11 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆150Updated last year
• omkaark / simple-federated-learning
  ☆98Updated last year
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆132Updated 10 months ago
• a1k0n / a1gpt
  throwaway GPT inference
  ☆139Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆187Updated last year
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆492Updated 8 months ago