LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
☆129Jun 10, 2023Updated 2 years ago
Alternatives and similar repositories for llama-server
Users that are interested in llama-server are comparing it to the libraries listed below
Sorting:
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆38Jun 6, 2023Updated 2 years ago
- Falcon LLM ggml framework with CPU and GPU support☆249Jan 22, 2024Updated 2 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and FastChat-T5.☆11May 26, 2023Updated 2 years ago
- ☆12Feb 13, 2021Updated 5 years ago
- ☆21Jan 22, 2026Updated last month
- IRIS: Demonstrator for use of LLMs in python (outdated)☆63Mar 23, 2025Updated 11 months ago
- FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Data (NAACL 2025)☆15Jul 14, 2025Updated 7 months ago
- Debian, Arch Linux ARM for non-protected VM with Crosvm on Android 15 +☆20Jan 23, 2026Updated last month
- HuggingChat like UI in Gradio☆70May 23, 2023Updated 2 years ago
- larry.ai: A Batteries Included ChatGPT Frontend Framework & HTTP Proxy☆17Jan 16, 2024Updated 2 years ago
- A static web ui for llama.cpp server. The llama.cpp chat interface for everyone. base on chatbot-ui☆17Oct 27, 2024Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Sep 10, 2024Updated last year
- A general purpose broadcasting web-socket server, written in node.js. Compatible with v17.3-ninja☆30Oct 8, 2025Updated 4 months ago
- ☆51Feb 5, 2025Updated last year
- ☆22Sep 4, 2023Updated 2 years ago
- Prompt Fine-tuning on GLM, BART and Flan-T5.☆21Jan 20, 2023Updated 3 years ago
- A little file for doing LLM-assisted prompt expansion and image generation using Flux.schnell - complete with prompt history, prompt queu…☆26Aug 16, 2024Updated last year
- Langport is a language model inference service☆94Sep 9, 2024Updated last year
- Experimental adventure game with AI-generated content☆111Apr 15, 2025Updated 10 months ago
- A macOS version of the oobabooga gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA…☆24Aug 7, 2025Updated 6 months ago
- This are a series of ComfyUI workflows that work together to create and repurpose animation☆39Aug 10, 2025Updated 6 months ago
- 💬 modular open source LLM server, web and desktop app☆63May 25, 2023Updated 2 years ago
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆66Oct 9, 2023Updated 2 years ago
- Implementation of Corrective RAG using LangChain and LangGraph.☆28Mar 14, 2025Updated 11 months ago
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆29May 6, 2025Updated 9 months ago
- NNT Neural Network Toolkit Custom Nodes for ComfyUI☆68Jan 8, 2025Updated last year
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Feb 18, 2024Updated 2 years ago
- Gradio Client in Rust.☆28Nov 30, 2025Updated 3 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆615Feb 17, 2025Updated last year
- Midori AI's Mono Repo! Check out our site below!☆125Aug 4, 2025Updated 7 months ago
- Python bindings for llama.cpp☆10,020Aug 15, 2025Updated 6 months ago
- Full sound spectrum visualization on a 3D sphere with three.js☆28Dec 22, 2018Updated 7 years ago
- A QT GUI for large language models☆39Dec 27, 2023Updated 2 years ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31May 22, 2024Updated last year
- A Python tool for parsing and exporting 'aws-nuke' output logs into structured JSON or CSV formats.☆10Jun 7, 2024Updated last year
- ☆32Feb 3, 2026Updated last month
- help you to create Local tasks are what generate the tabs on top of pages (up to two levels).☆10Jan 11, 2016Updated 10 years ago
- ☆25May 12, 2024Updated last year
- A universal messaging library for cross-platform applications (Chrome extension, Web, Mobile, Iframe,...)☆15Oct 10, 2025Updated 4 months ago