CharlesMod / quantizeHFmodel
Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
☆38Updated last year
Alternatives and similar repositories for quantizeHFmodel:
Users that are interested in quantizeHFmodel are comparing it to the libraries listed below
- Science-driven chatbot development☆56Updated 10 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated 2 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 6 months ago
- Interact with a AI Game-engine that keep building its rules and world as you play, adapted to your gameplay.☆42Updated 9 months ago
- Text generation in Python, as easy as possible☆55Updated last week
- Diffusion_TTS extension for booga☆66Updated 8 months ago
- annoy long term memory experiment for oobabooga/text-generation-webui☆31Updated last year
- LLM backed Fantasy Tribe Game☆18Updated 3 months ago
- ☆16Updated last year
- Traing PRO extension for oobabooga WebUI - recent dev version☆48Updated last month
- idea: https://github.com/nyxkrage/ebook-groupchat/☆86Updated 6 months ago
- An API for VoiceCraft.☆25Updated 8 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆63Updated 4 months ago
- This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…☆53Updated 4 months ago
- Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.☆35Updated last year
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆25Updated 2 months ago
- LIVA - Local Intelligent Voice Assistant☆61Updated 6 months ago
- V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!☆34Updated this week
- Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …☆33Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated 10 months ago
- Discord chatbot interface to train an LLM on user message history☆27Updated last year
- Easily view and modify JSON datasets for large language models☆71Updated last week
- Experimental LLM Inference UX to aid in creative writing☆112Updated 3 months ago
- run ollama & gguf easily with a single command☆49Updated 10 months ago
- A web search extension for Oobabooga's text-generation-webui (now with nougat)☆73Updated 8 months ago
- A simple extension that uses Bark Text-to-Speech for audio output☆35Updated last year
- An extension for text-generation-webui by oobabooga. Adds options to keep tabs on page and to move extensions into a sidebar.☆22Updated last year
- ☆21Updated 4 months ago
- Yet Another (LLM) Web UI, made with Gemini☆11Updated 2 months ago
- A plugin for Oobabooga TextUI that allows you to search multiple search engines. Initially we're using Google API or DuckDuckGo.☆16Updated last year