Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
☆32May 25, 2023Updated 3 years ago
Alternatives and similar repositories for alpaca_lora_4bit_readme
Users that are interested in alpaca_lora_4bit_readme are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆534Dec 1, 2023Updated 2 years ago
- A fork of textgen that kept some things like Exllama and old GPTQ.☆22Aug 20, 2024Updated last year
- A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda☆21Mar 27, 2023Updated 3 years ago
- ☆14Oct 30, 2023Updated 2 years ago
- Precompiled Wheels for GPTQ-for-LLaMa☆19Jul 26, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.☆23Oct 6, 2023Updated 2 years ago
- Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.☆37Jul 28, 2023Updated 3 years ago
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆108Oct 29, 2024Updated last year
- ChatGPT CSS style☆14Apr 28, 2024Updated 2 years ago
- Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …☆32Nov 20, 2023Updated 2 years ago
- Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance☆28Mar 1, 2023Updated 3 years ago
- Recursive-descent parsers and scanners generaror☆21Apr 9, 2026Updated 3 months ago
- Fast and memory-efficient exact attention - Windows wheels☆33Mar 3, 2024Updated 2 years ago
- ☆69Jan 26, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets☆69Jun 4, 2024Updated 2 years ago
- 4 bits quantization of LLaMA using GPTQ☆3,072Jul 13, 2024Updated 2 years ago
- HandBrakeCLI wrapper for processing mkv files using suitable default values in batches☆13Jul 9, 2021Updated 5 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Jun 16, 2023Updated 3 years ago
- Generate Large Language Model text in a container.☆20Mar 24, 2023Updated 3 years ago
- BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui☆85May 6, 2023Updated 3 years ago
- Minimalistic, pluggable Golang evloop/timer handler with dependency-injection☆16Aug 12, 2018Updated 7 years ago
- An extension for text-generation-webui by oobabooga. Adds options to keep tabs on page and to move extensions into a sidebar.☆23Sep 24, 2023Updated 2 years ago
- An all-in one place for information and creation of BD class droids from Behold-Urwar Droid Concepts☆13Aug 5, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Collection of usefull scripts for RunPod pods☆15Jan 26, 2024Updated 2 years ago
- An extension to Oobabooga to add a simple memory function for chat☆25Jun 5, 2023Updated 3 years ago
- Standalone, local-runnable binaries of popular linux distributions☆10Dec 15, 2021Updated 4 years ago
- ☆28Aug 30, 2023Updated 2 years ago
- GitHub Repository Naming Suggestion Service: AI powered naming suggestions for your GitHub repositories☆17Jan 9, 2023Updated 3 years ago
- A tiny redistribution of TypeScript☆17Feb 13, 2023Updated 3 years ago
- A reverse Geo lookup service written in C, accessible via HTTP and backed by OpenCage and LMDB☆15Aug 20, 2025Updated 11 months ago
- Quickly start a temporary container and go into the container's terminal. Easy to remember!☆16Jul 30, 2023Updated 2 years ago
- 🆚🐟 Fish port of Visual Studio Code's Terminal Shell Integration☆13Aug 18, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Babyagi, an Autonomous and Self-Improving agent: BASI for Traders☆21Aug 22, 2024Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆11Apr 26, 2023Updated 3 years ago
- CI scripts designed to build a Pascal-compatible version of vLLM.☆13Aug 10, 2024Updated last year
- create a model of computed properties from another backbone model☆18Mar 2, 2014Updated 12 years ago
- Where we keep our notes about model training runs.☆16Mar 12, 2023Updated 3 years ago
- Simplified installers for oobabooga/text-generation-webui.☆53Sep 16, 2023Updated 2 years ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 2 years ago