Alternatives and similar repositories for llama-cpp-container

Users that are interested in llama-cpp-container are comparing it to the libraries listed below

• andrewgcodes / FalconStreaming
  Falcon40B and 7B (Instruct) with streaming, top-k, and beam search
  ☆40Updated 2 years ago
• sebaxzero / LangChain_PDFChat_Oobabooga
  oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local
  ☆71Updated 2 years ago
• wafflecomposite / langchain-ask-pdf-local
  An AI-app that allows you to upload a PDF and ask questions about it. It uses StableVicuna 13B and runs locally.
  ☆93Updated 2 years ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated last year
• replicate / cog-whisper
  Run OpenAI Whisper as a Cog model
  ☆65Updated 10 months ago
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆170Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated last year
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆113Updated 2 years ago
• the-crypt-keeper / tiny_starcoder
  Python examples using the bigcode/tiny_starcoder_py 159M model to generate code
  ☆45Updated 2 years ago
• chroma-core / onnx-embedding
  A repository for creating, and sample code for consuming an ONNX embedding model
  ☆33Updated 2 years ago
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆243Updated last year
• deep-diver / gradio-chat
  HuggingChat like UI in Gradio
  ☆71Updated 2 years ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated 2 years ago
• Pan-ML / panml
  PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
  ☆117Updated 2 years ago
• hwchase17 / langchain-gradio-template
  ☆137Updated 2 years ago
• amrrs / openai-whisper-webapp
  Code for OpenAI Whisper Web App Demo
  ☆93Updated 3 years ago
• absadiki / pyllamacpp
  Python bindings for llama.cpp
  ☆66Updated last year
• georgesung / LLM-WikipediaQA
  Document Q&A on Wikipedia articles using LLMs
  ☆79Updated 2 years ago
• ChuloAI / oasis
  Local LLaMAs/Models in VSCode
  ☆54Updated 2 years ago
• nateraw / replicate-examples
  ☆74Updated last year
• bigcode-project / jupytercoder
  ☆141Updated last year
• juyongjiang / CodeUp
  CodeUp: A Multilingual Code Generation Llama-X Model with Parameter-Efficient Instruction-Tuning
  ☆127Updated 9 months ago
• laelhalawani / gguf_modeldb
  A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…
  ☆12Updated last year
• Paperspace / ml-in-a-box
  Machine learning tool-set for Paperspace VMs
  ☆59Updated last year
• run-llama / mixtral_ollama
  ☆47Updated last year
• Lisoveliy / StarCoderEx
  Extension for using alternative GitHub Copilot (StarCoder API) in VSCode
  ☆100Updated last year
• zhoupingjay / llm_voice_chatbot_rpi
  Local LLM-based voice chatbot running on Raspberry Pi
  ☆33Updated last year
• ausboss / Local-LLM-Langchain
  Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…
  ☆214Updated 2 years ago
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆307Updated last year