mostlygeek / llama-swap
HTTP proxy for on-demand model loading with llama.cpp (or other OpenAI compatible backends)
☆33Updated this week
Related projects ⓘ
Alternatives and complementary repositories for llama-swap
- Easily view and modify JSON datasets for large language models☆62Updated last month
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆46Updated last month
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆58Updated last month
- ☆30Updated 6 months ago
- ☆117Updated this week
- A frontend for creative writing with LLMs☆106Updated 3 months ago
- A bot that checks your grammar and phrasing using LLM of choice☆27Updated 5 months ago
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)☆47Updated 3 weeks ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆81Updated 2 months ago
- 4 million public stable diffusion prompts -- interactive neural search and llama chat☆19Updated 2 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆35Updated 2 weeks ago
- Experimental LLM Inference UX to aid in creative writing☆104Updated 3 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆68Updated 2 months ago
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆88Updated this week
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 2 months ago
- ☆18Updated 2 weeks ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆95Updated 3 weeks ago
- ☆25Updated last month
- Creates an index of images, queries a local LLM and adds tags to the image metadata☆63Updated last month
- Something similar to Apple Intelligence?☆57Updated 4 months ago
- This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…☆88Updated 3 months ago
- ☆110Updated 2 weeks ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆42Updated 9 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆44Updated last week
- Gradio based tool to run opensource LLM models directly from Huggingface☆87Updated 4 months ago
- A fast batching API to serve LLM models☆172Updated 6 months ago
- vnc-lm is a Discord bot for accessing local and hosted large language models.☆45Updated this week
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆164Updated this week
- A simple light terminal style chat app that lets you use connect to your local llama.cpp server☆27Updated 4 months ago
- SoftWhisper simplifies audio and video transcription using the powerful Whisper model. Easily select custom models, languages, and tasks,…☆31Updated last month