kooshi / llama-swappoLinks
llama-swap + a minimal ollama compatible api
☆33Updated 2 weeks ago
Alternatives and similar repositories for llama-swappo
Users that are interested in llama-swappo are comparing it to the libraries listed below
Sorting:
- ☆85Updated last week
- GPU Power and Performance Manager☆61Updated last year
- "Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp …☆36Updated 2 years ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆83Updated 3 weeks ago
- ☆49Updated last month
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆81Updated this week
- A local front-end for open-weight LLMs with memory, RAG, TTS/STT, Elo ratings, and dynamic research tools. Built with React and FastAPI.☆38Updated 3 months ago
- A simple Gradio WebUI for loading/unloading models and loras in tabbyAPI.☆20Updated last year
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆48Updated 3 months ago
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆23Updated last year
- A simple tool to anonymize LLM prompts.☆65Updated 9 months ago
- ☆35Updated last year
- ☆28Updated 5 months ago
- A utility that uses Whisper to transcribe videos and various translation APIs to translate the transcribed text and save them as SRT (sub…☆73Updated last year
- Generate Your Own Private Morning Radio for Commute☆33Updated 9 months ago
- A daemon that automatically manages the performance states of NVIDIA GPUs.☆97Updated 2 weeks ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆46Updated 2 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆79Updated last year
- Chat with AI using whisper, LLMs, and TTS☆24Updated last year
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆241Updated last week
- No-messing-around sh client for llama.cpp's server☆30Updated last year
- ☆83Updated 8 months ago
- Open source LLM UI, compatible with all local LLM providers.☆176Updated last year
- Copy a bunch of files into your clipboard to provide context for LLMs☆110Updated 5 months ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆11Updated 5 months ago
- Neo AI integrates into the Linux terminal, capable of executing system commands and providing helpful information.☆121Updated 7 months ago
- ☆20Updated last year
- ☆36Updated 3 months ago
- Easily view and modify JSON datasets for large language models☆84Updated 6 months ago