CharlesMod / quantizeHFmodel
Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
☆38Updated last year
Alternatives and similar repositories for quantizeHFmodel:
Users that are interested in quantizeHFmodel are comparing it to the libraries listed below
- Text generation in Python, as easy as possible☆55Updated this week
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 7 months ago
- LLM backed Fantasy Tribe Game☆18Updated 4 months ago
- Traing PRO extension for oobabooga WebUI - recent dev version☆48Updated last month
- Science-driven chatbot development☆56Updated 10 months ago
- This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…☆53Updated 4 months ago
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- ☆16Updated last year
- A frontend for creative writing with LLMs☆122Updated 8 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated this week
- An API for VoiceCraft.☆25Updated 8 months ago
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆25Updated 2 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆86Updated 7 months ago
- Diffusion_TTS extension for booga☆66Updated 8 months ago
- Yet Another (LLM) Web UI, made with Gemini☆11Updated 2 months ago
- Mistral7B playing DOOM☆28Updated 11 months ago
- annoy long term memory experiment for oobabooga/text-generation-webui☆31Updated last year
- ☆27Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated 11 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆44Updated last year
- Interact with a AI Game-engine that keep building its rules and world as you play, adapted to your gameplay.☆42Updated 9 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆32Updated 8 months ago
- Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …☆33Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated 9 months ago
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆108Updated 4 months ago
- Experimental sampler to make LLMs more creative☆30Updated last year
- ☆21Updated 4 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆64Updated 4 months ago