Alternatives and similar repositories for alpaca.cpp

Users that are interested in alpaca.cpp are comparing it to the libraries listed below

• NouamaneTazi / bloomz.cpp
  C++ implementation for BLOOM
  ☆809Updated 2 years ago
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆412Updated 2 years ago
• zanussbaum / gpt4all.cpp
  Locally run an Assistant-Tuned Chat-Style LLM
  ☆496Updated 2 years ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆459Updated 2 years ago
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆311Updated 2 years ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆326Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆249Updated 2 years ago
• amrrs / llama-4bit-colab
  llama-4bit-colab
  ☆63Updated 2 years ago
• paolorechia / learn-langchain
  ☆276Updated 2 years ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• thomasantony / llamacpp-python
  Python bindings for llama.cpp
  ☆198Updated 2 years ago
• nomic-ai / pygpt4all
  Official supported Python bindings for llama.cpp + gpt4all
  ☆1,016Updated 2 years ago
• teknium1 / alpaca-roleplay-discordbot
  A discord bot that roleplays!
  ☆152Updated 2 years ago
• petals-infra / chat.petals.dev
  💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
  ☆316Updated last year
• shawwn / llama
  Inference code for LLaMA models
  ☆189Updated 2 years ago
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆323Updated 2 years ago
• rhohndorf / Auto-Llama-cpp
  Uses Auto-GPT with Llama.cpp
  ☆385Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated 2 years ago
• melodysdreamj / WizardVicunaLM
  LLM that combines the principles of wizardLM and vicunaLM
  ☆716Updated 2 years ago
• abacaj / mpt-30B-inference
  Run inference on MPT-30B using CPU
  ☆576Updated 2 years ago
• lhenault / simpleAI
  An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
  ☆332Updated last year
• randaller / llama-chat
  Chat with Meta's LLaMA models at home made easy
  ☆842Updated 2 years ago
• kroll-software / babyagi4all
  BabyAGI to run with GPT4All
  ☆249Updated 2 years ago
• teknium1 / alpaca-discord
  A Simple Discord Bot for the Alpaca LLM
  ☆99Updated 2 years ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• pointnetwork / point-alpaca
  ☆404Updated 2 years ago
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆109Updated 2 years ago
• keldenl / gpt-llama.cpp
  A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…
  ☆597Updated 2 years ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆100Updated 2 years ago
• skeskinen / llama-lite
  Embeddings focused small version of Llama NLP model
  ☆107Updated 2 years ago