kooshi / llama-swappoLinks
llama-swap + a minimal ollama compatible api
☆23Updated this week
Alternatives and similar repositories for llama-swappo
Users that are interested in llama-swappo are comparing it to the libraries listed below
Sorting:
- "Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp …☆36Updated 2 years ago
- ☆82Updated last week
- A simple Gradio WebUI for loading/unloading models and loras in tabbyAPI.☆20Updated 9 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆73Updated 2 weeks ago
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆44Updated 2 weeks ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆74Updated last week
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆163Updated last year
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆73Updated 10 months ago
- A library and CLI utilities for managing performance states of NVIDIA GPUs.☆28Updated 10 months ago
- Writing Extension for Text Generation WebUI☆63Updated 3 weeks ago
- Generate Your Own Private Morning Radio for Commute☆33Updated 7 months ago
- ☆41Updated last month
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆43Updated this week
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆22Updated 11 months ago
- A local front-end for open-weight LLMs with memory, RAG, TTS/STT, Elo ratings, and dynamic research tools. Built with React and FastAPI.☆36Updated 3 weeks ago
- A frontend for creative writing with LLMs☆134Updated last year
- Orpheus Chat WebUI☆73Updated 5 months ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆11Updated 3 months ago
- GPU Power and Performance Manager☆61Updated 10 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Updated last year
- Open source LLM UI, compatible with all local LLM providers.☆174Updated 11 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆80Updated 11 months ago
- ☆83Updated 6 months ago
- ☆50Updated 6 months ago
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆66Updated 5 months ago
- My personal fork of koboldcpp where I hack in experimental samplers.☆47Updated last year
- 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…☆32Updated last month
- A simple tool to anonymize LLM prompts.☆64Updated 7 months ago
- Easily view and modify JSON datasets for large language models☆82Updated 3 months ago
- ☆20Updated 11 months ago