Nondzu / LlamaTor
LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.
☆40Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for LlamaTor
- HTTP proxy for on-demand model loading with llama.cpp (or other OpenAI compatible backends)☆41Updated this week
- Experimental LLM Inference UX to aid in creative writing☆106Updated 4 months ago
- A frontend for creative writing with LLMs☆108Updated 4 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆45Updated 2 weeks ago
- A Qt GUI for large language models☆40Updated last year
- ☆128Updated this week
- A simple light terminal style chat app that lets you use connect to your local llama.cpp server☆27Updated 4 months ago
- ☆18Updated last month
- Implements harmful/harmless refusal removal using pure HF Transformers☆25Updated 5 months ago
- Large Model Proxy is designed to make it easy to run multiple resource-heavy Large Models (LM) on the same machine with limited amount of…☆47Updated last month
- ☆104Updated 8 months ago
- Easily view and modify JSON datasets for large language models☆62Updated last month
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆42Updated 9 months ago
- A fast batching API to serve LLM models☆172Updated 6 months ago
- ☆40Updated 2 months ago
- ☆30Updated 6 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 8 months ago
- Easily create LLM automation/agent workflows☆55Updated 9 months ago
- ☆31Updated 10 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆58Updated 2 months ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 3 months ago
- Self-contained, minimalistic implementation of a language model that generates coherent and normal sounding names. It uses an input datas…☆49Updated 8 months ago
- Let's create synthetic textbooks together :)☆70Updated 9 months ago
- CHAracter State Management - a generative text adventure (engine)☆61Updated last month
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆96Updated last month
- Demo of an "always-on" AI assistant.☆23Updated 9 months ago
- Traing PRO extension for oobabooga WebUI - recent dev version☆46Updated 2 months ago