Alternatives and similar repositories for gemma.cpp

Users that are interested in gemma.cpp are comparing it to the libraries listed below

• google / gemma_pytorch
  The official PyTorch implementation of Google's Gemma models
  ☆5,581Updated 6 months ago
• google-deepmind / gemma
  Gemma open-weight LLM library, from Google DeepMind
  ☆3,868Updated 3 weeks ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,648Updated 2 weeks ago
• meta-pytorch / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,162Updated 3 months ago
• AI-Hypercomputer / maxtext
  A simple, performant and scalable Jax LLM!
  ☆2,022Updated this week
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆10,195Updated last year
• LargeWorldModel / LWM
  Large World Model -- Modeling Text and Video with Millions Context
  ☆7,379Updated last year
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆6,208Updated 2 weeks ago
• meta-pytorch / torchtune
  PyTorch native post-training library
  ☆5,608Updated this week
• pytorch / executorch
  On-device AI across mobile, embedded and edge for PyTorch
  ☆3,634Updated this week
• apple / corenet
  CoreNet: A library for training deep neural networks
  ☆7,025Updated 2 months ago
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,324Updated last year
• apple / axlearn
  An Extensible Deep Learning Library
  ☆2,296Updated 2 weeks ago
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,561Updated 2 weeks ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,620Updated 2 months ago
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,116Updated last week
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,995Updated last year
• intel / intel-extension-for-transformers
  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…
  ☆2,169Updated last year
• openai / transformer-debugger
  ☆4,110Updated last year
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,534Updated last year
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,434Updated 4 months ago
• microsoft / PhiCookBook
  This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi…
  ☆3,612Updated last week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,262Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,684Updated 2 weeks ago
• leptonai / leptonai
  A Pythonic framework to simplify AI service building
  ☆2,801Updated this week
• facebookresearch / jepa
  PyTorch code and models for V-JEPA self-supervised learning from video.
  ☆3,299Updated 9 months ago
• apple / ml-ferret
  ☆8,665Updated last year
• GoogleCloudPlatform / localllm
  ☆1,552Updated last year
• meta-llama / llama-cookbook
  Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…
  ☆18,067Updated last month
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆4,778Updated last week