jllllll / llama-cpp-python-cuBLAS-wheelsLinks
Wheels for llama-cpp-python compiled with cuBLAS support
☆97Updated last year
Alternatives and similar repositories for llama-cpp-python-cuBLAS-wheels
Users that are interested in llama-cpp-python-cuBLAS-wheels are comparing it to the libraries listed below
Sorting:
- A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.☆22Updated last year
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆109Updated 7 months ago
- Text WebUI extension to add clever Notebooks to Chat mode☆139Updated last year
- Extension for Text Generation Webui based on EdgeGPT, a reverse engineered API of Microsoft's Bing Chat AI☆126Updated last year
- 4 bits quantization of LLaMa using GPTQ☆129Updated 2 years ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆74Updated last year
- A fast batching API to serve LLM models☆181Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆63Updated last year
- An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets☆67Updated last year
- automatically quant GGUF models☆181Updated this week
- Science-driven chatbot development☆57Updated last year
- This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…☆54Updated 7 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆104Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- Wheels for llama-cpp-python compiled with cuBLAS support☆24Updated last month
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆30Updated 2 years ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated last year
- An autonomous AI agent extension for Oobabooga's web ui☆174Updated last year
- Integrate image generation capabilities to text-generation-webui using Stable Diffusion.☆54Updated last year
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- XTTSv2 Extension for oobabooga text-generation-webui☆154Updated last year
- Web UI for ExLlamaV2☆495Updated 4 months ago
- A web search extension for Oobabooga's text-generation-webui (now with nougat)☆74Updated 10 months ago
- A prompt/context management system☆170Updated 2 years ago
- Model REVOLVER, a human in the loop model mixing system.☆32Updated last year
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo☆246Updated 2 weeks ago
- Python bindings for llama.cpp☆65Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆54Updated 9 months ago
- A multimodal, function calling powered LLM webui.☆214Updated 8 months ago