Alternatives and similar repositories for gemma.cpp

Users that are interested in gemma.cpp are comparing it to the libraries listed below

• google / gemma_pytorch
  The official PyTorch implementation of Google's Gemma models
  ☆5,543Updated 3 months ago
• google-deepmind / gemma
  Gemma open-weight LLM library, from Google DeepMind
  ☆3,702Updated last week
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆9,922Updated last year
• meta-pytorch / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,093Updated 3 weeks ago
• pytorch / executorch
  On-device AI across mobile, embedded and edge for PyTorch
  ☆3,221Updated this week
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,319Updated last year
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,170Updated this week
• LargeWorldModel / LWM
  Large World Model -- Modeling Text and Video with Millions Context
  ☆7,339Updated 10 months ago
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,329Updated last month
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,985Updated last week
• apple / axlearn
  An Extensible Deep Learning Library
  ☆2,239Updated last week
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,528Updated 10 months ago
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,484Updated this week
• ridgerchu / matmulfreellm
  Implementation for MatMul-free LM.
  ☆3,032Updated last month
• apple / corenet
  CoreNet: A library for training deep neural networks
  ☆7,023Updated 3 weeks ago
• AI-Hypercomputer / maxtext
  A simple, performant and scalable Jax LLM!
  ☆1,899Updated this week
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,741Updated last year
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,119Updated last year
• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆7,838Updated 2 weeks ago
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,735Updated last year
• facebookresearch / jepa
  PyTorch code and models for V-JEPA self-supervised learning from video.
  ☆3,200Updated 6 months ago
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,459Updated 5 months ago
• karpathy / llm.c
  LLM training in simple, raw C/CUDA
  ☆27,588Updated 2 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,609Updated last week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,088Updated last week
• openxla / xla
  A machine learning compiler for GPUs, CPUs, and ML accelerators
  ☆3,505Updated this week
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆4,395Updated this week
• openai / transformer-debugger
  ☆4,092Updated last year
• kyegomez / BitNet
  Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
  ☆1,875Updated last week
• Vahe1994 / AQLM
  Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.p…
  ☆1,291Updated last month