Highlyhotgames / fast_txtgen_7B
Installation Script for LLaMa 7B 4bit 128g on WSL
☆27Updated last year
Alternatives and similar repositories for fast_txtgen_7B:
Users that are interested in fast_txtgen_7B are comparing it to the libraries listed below
- ☆16Updated last year
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated last year
- Experimental sampler to make LLMs more creative☆30Updated last year
- run ollama & gguf easily with a single command☆50Updated 11 months ago
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- ☆39Updated last year
- An auto generated wiki.☆21Updated last year
- Reweight GPT - a simple neural network using transformer architecture for next character prediction☆53Updated last year
- GPT-2 small trained on phi-like data☆66Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆74Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆54Updated 8 months ago
- annoy long term memory experiment for oobabooga/text-generation-webui☆31Updated last year
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year
- Finetune any model on HF in less than 30 seconds☆58Updated 2 weeks ago
- A Qt GUI for large language models☆42Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- ☆50Updated last year
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- This project aims to combine the latest LLMs, Multi-Step Asynchronous Function Calling, Natural Language Processing, and Text-to-Speech.☆37Updated last year
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆44Updated last year
- ☆12Updated last year
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆70Updated last year
- Self-contained, minimalistic implementation of a language model that generates coherent and normal sounding names. It uses an input datas…☆50Updated last year
- oobabooga extension - Experimental sampler to make LLMs more creative☆23Updated last year
- ☆24Updated 10 months ago
- Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.☆35Updated last year
- A repository to store helpful information and emerging insights in regard to LLMs☆20Updated last year