Alternatives and similar repositories for llama4micro:

Users that are interested in llama4micro are comparing it to the libraries listed below

• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆176Updated last year
• sumo43 / loopvlm
  run paligemma in real time
  ☆129Updated 8 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆127Updated 6 months ago
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated 7 months ago
• likejazz / llama3.np
  llama3.np is a pure NumPy implementation for Llama 3 model.
  ☆972Updated 7 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆180Updated 8 months ago
• mit-han-lab / TinyChatEngine
  TinyChatEngine: On-Device LLM Inference Library
  ☆797Updated 6 months ago
• google-ai-edge / model-explorer
  A modern model graph visualizer and debugger
  ☆1,109Updated this week
• usefulsensors / useful-transformers
  Efficient Inference of Transformer models
  ☆414Updated 5 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆514Updated 10 months ago
• Cerebras / gigaGPT
  a small code base for training large models
  ☆283Updated last month
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆420Updated 5 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 6 months ago
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆250Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆89Updated 9 months ago
• MarioSieg / magnetron
  (WIP) A small but powerful, homemade PyTorch from scratch.
  ☆516Updated this week
• AMD-AIG-AIMA / AMD-LLM
  ☆180Updated 5 months ago
• vitoplantamura / OnnxStream
  Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but…
  ☆1,899Updated last week
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆614Updated 6 months ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆251Updated 3 weeks ago
• mlecauchois / micrograd-cuda
  ☆238Updated 10 months ago
• trevorpogue / algebraic-nnhw
  Algebraic enhancements for GEMM & AI accelerators
  ☆263Updated this week
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆562Updated last year
• tinygrad / teenygrad
  If tinygrad wasn't small enough for you...
  ☆677Updated 10 months ago
• YavorGIvanov / sam.cpp
  ☆1,268Updated last year
• Fuzzy-Search / realtime-bakllava
  llama.cpp with BakLLaVA model describes what does it see
  ☆380Updated last year
• eevaain / tiny-tpu
  A minimal Tensor Processing Unit (TPU) inspired by Google's TPUv1.
  ☆126Updated 5 months ago
• NouamaneTazi / bloomz.cpp
  C++ implementation for BLOOM
  ☆810Updated last year
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆475Updated 5 months ago
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆706Updated last year