kooshi / llama-swappoLinks
llama-swap + a minimal ollama compatible api
☆30Updated last week
Alternatives and similar repositories for llama-swappo
Users that are interested in llama-swappo are comparing it to the libraries listed below
Sorting:
- ☆48Updated 2 weeks ago
- ☆84Updated 3 weeks ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆81Updated last week
- "Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp …☆36Updated 2 years ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆165Updated last year
- Prometheus exporter for Linux based GDDR6/GDDR6X VRAM and GPU Core Hot spot temperature reader for NVIDIA RTX 3000/4000 series GPUs.☆23Updated last year
- A local front-end for open-weight LLMs with memory, RAG, TTS/STT, Elo ratings, and dynamic research tools. Built with React and FastAPI.☆37Updated 2 months ago
- GPU Power and Performance Manager☆60Updated last year
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆77Updated 11 months ago
- A simple tool to anonymize LLM prompts.☆65Updated 9 months ago
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆48Updated 2 months ago
- llm client, server and agent☆73Updated this week
- Generate Your Own Private Morning Radio for Commute☆33Updated 8 months ago
- A utility that uses Whisper to transcribe videos and various translation APIs to translate the transcribed text and save them as SRT (sub…☆73Updated last year
- A frontend for creative writing with LLMs☆134Updated last year
- Code for Papeg.ai☆225Updated 9 months ago
- Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.☆80Updated 3 weeks ago
- Open source LLM UI, compatible with all local LLM providers.☆176Updated last year
- ☆20Updated last year
- Efforts toward giving Qwen 3 Coder 30B A3B proper agentic tool calling capabilities at or near 100% reliability.☆62Updated 2 months ago
- Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.☆44Updated last year
- ☆35Updated last year
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆226Updated this week
- Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…☆66Updated 6 months ago
- reddacted lets you analyze & sanitize your online footprint using LLMs, PII detection & sentiment analysis to identify anything that migh…☆111Updated 3 months ago
- ☆83Updated 8 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆262Updated 7 months ago
- Writing Extension for Text Generation WebUI☆63Updated 2 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆53Updated last year
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated 3 weeks ago