Alternatives and similar repositories for llama.cpp

Users that are interested in llama.cpp are comparing it to the libraries listed below

• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆44Updated 2 years ago
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆100Updated 2 years ago
• MF-FOOM / wikivec2text
  Simple embedding -> text model trained on a small subset of Wikipedia sentences.
  ☆158Updated 2 years ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆311Updated 2 years ago
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆175Updated 2 years ago
• teknium1 / RawTransform
  A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.
  ☆31Updated 2 years ago
• NolanoOrg / InstructLLaMa.cpp
  Fast inference of Instruct tuned LLaMa on your personal devices.
  ☆23Updated 2 years ago
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆183Updated 3 months ago
• RyanLucas3 / poasterGPT
  A single notebook for fine-tuning GPT-3.5 turbo
  ☆31Updated last year
• teknium1 / alpaca-discord
  A Simple Discord Bot for the Alpaca LLM
  ☆99Updated 2 years ago
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆75Updated 2 years ago
• jquesnelle / crt-terminal
  Retro styled terminal shell
  ☆26Updated last year
• closedai-project / closedai
  Drop in replacement for OpenAI, but with Open models.
  ☆154Updated 2 years ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 4 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆105Updated 2 years ago
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆142Updated last year
• Narsil / fast_gpt2
  ☆157Updated 2 years ago
• yacineMTB / scribepod
  Some of the scripts I use for scribepod @ https://scribepod.substack.com/, an automated AI podcast
  ☆174Updated 2 years ago
• teknium1 / alpaca-roleplay-discordbot
  A discord bot that roleplays!
  ☆152Updated 2 years ago
• 0hq / chessgpt
  ☆19Updated 2 years ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆83Updated 2 years ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆45Updated 11 months ago
• atroyn / math-llm
  Grounding LLM mathematical reasoning with proof assistants.
  ☆64Updated 2 years ago
• sfcompute / tinynarrations
  A synthetic story narration dataset to study small audio LMs.
  ☆31Updated 2 years ago
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆42Updated 2 years ago
• yacineMTB / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆10Updated 2 years ago
• yacineMTB / talk
  Let's make sand talk
  ☆590Updated 2 years ago
• NolanoOrg / smol-gpt
  Smol but mighty language model
  ☆65Updated 2 years ago