Highlyhotgames / fast_txtgen_7B
Installation Script for LLaMa 7B 4bit 128g on WSL
☆27Updated last year
Alternatives and similar repositories for fast_txtgen_7B
Users that are interested in fast_txtgen_7B are comparing it to the libraries listed below
Sorting:
- Experimental sampler to make LLMs more creative☆31Updated last year
- ☆16Updated last year
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆70Updated 2 years ago
- ☆73Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆74Updated last year
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated last year
- ☆12Updated last year
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- A Qt GUI for large language models☆42Updated last year
- An auto generated wiki.☆21Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Text generation in Python, as easy as possible☆60Updated this week
- A guidance language for controlling large language models.☆45Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- annoy long term memory experiment for oobabooga/text-generation-webui☆31Updated last year
- A small standalone flask python server for llama.cpp that acts like a KoboldAI api.☆13Updated last year
- Discord chatbot interface to train an LLM on user message history☆27Updated last year
- Extension for Text Generation Webui based on EdgeGPT, a reverse engineered API of Microsoft's Bing Chat AI☆126Updated last year
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆44Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆92Updated last year
- ☆39Updated last year
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- Mistral7B playing DOOM☆28Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆111Updated last year
- GPT-2 small trained on phi-like data☆66Updated last year
- ☆52Updated 3 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆105Updated last year
- Makes llama.cpp easy to use.☆12Updated 2 weeks ago
- ☆70Updated last month