Alternatives and similar repositories for llama2.cpp

Users that are interested in llama2.cpp are comparing it to the libraries listed below

• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• KhawajaAbaid / micrograd_c
  Andrej Kapathy's micrograd implemented in c
  ☆30Updated last year
• character-ai / MuKoe
  ☆55Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆99Updated 8 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆59Updated last month
• zaydzuhri / pythia-mlkv
  Multi-Layer Key-Value sharing experiments on Pythia models
  ☆34Updated last year
• AlexBodner / How_Much_VRAM
  ☆101Updated last year
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆89Updated 2 weeks ago
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆112Updated last year
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆93Updated 2 weeks ago
• deepshard / mixtral-8x7b-Inference
  Eh, simple and works.
  ☆27Updated 2 years ago
• kanpuriyanawab / picograd
  Rust Implementation of micrograd
  ☆53Updated last year
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated 2 years ago
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆64Updated 9 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 3 months ago
• vtabbott / Neural-Circuit-Diagrams
  ☆169Updated last year
• AtakanTekparmak / agento
  Very minimal (and stateless) agent framework
  ☆44Updated last year
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated 4 months ago
• vithursant / nanoGPT_mlx
  Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
  ☆118Updated last year
• gpu-mode / triton-tutorials
  ☆16Updated 8 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆72Updated 3 weeks ago
• VikParuchuri / classified
  Score LLM pretraining data with classifiers
  ☆55Updated 2 years ago
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆53Updated 10 months ago
• bipul1010 / agents_tutorial
  ☆19Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 9 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆183Updated 2 years ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆90Updated last year
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆85Updated last year
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆68Updated 2 months ago