Precompiled Wheels for GPTQ-for-LLaMa
☆19Jul 26, 2023Updated 3 years ago
Alternatives and similar repositories for GPTQ-for-LLaMa-Wheels
Users that are interested in GPTQ-for-LLaMa-Wheels are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An extension to Oobabooga to add a simple memory function for chat☆25Jun 5, 2023Updated 3 years ago
- A simple batch file to make the oobabooga one click installer compatible with llama 4bit models and able to run on cuda☆21Mar 27, 2023Updated 3 years ago
- Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.☆37Jul 28, 2023Updated 3 years ago
- ChatGPT CSS style☆14Apr 28, 2024Updated 2 years ago
- ☆11Feb 5, 2026Updated 9 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆14Oct 30, 2023Updated 3 years ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆32May 25, 2023Updated 3 years ago
- Proxy server for quota, usage monitoring and tracking of OpenAI requests☆16Sep 21, 2023Updated 3 years ago
- oobabooga extension - Experimental sampler to make LLMs more creative☆23Aug 2, 2023Updated 3 years ago
- Automatically report unsafe prompts to the FBI.☆16Mar 12, 2023Updated 3 years ago
- Simplified installers for oobabooga/text-generation-webui.☆51Sep 16, 2023Updated 3 years ago
- ☆15May 22, 2024Updated 2 years ago
- An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets☆69Jun 4, 2024Updated 2 years ago
- Wheels for llama-cpp-python compiled with cuBLAS support☆104Feb 1, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Convert Huggingface Pytorch checkpoint to Tensorflow checkpoint☆17Sep 4, 2023Updated 3 years ago
- A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.☆23Oct 6, 2023Updated 3 years ago
- This repository is about implementing The Personality Cores Conversation System originally developed by Aperture Science, Inc. in the Por…☆24May 5, 2024Updated 2 years ago
- A simple converter which converts pytorch bin files to safetensor, intended to be used for LLM conversion.☆72Feb 4, 2024Updated 2 years ago
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- 医学预训练语言模型☆18Dec 17, 2020Updated 5 years ago
- Web page with political compass quiz results for open LLMs☆37Jan 31, 2024Updated 2 years ago
- LORA微调BLOOMZ，参考BELLE☆25Mar 24, 2023Updated 3 years ago
- DeepSeek-V4.1-Flash on 4x DGX Spark TP4 switchless RoCE ring - SGLang production recipe, 600K context, DSpark MTP, benchmark archive☆31Oct 1, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …☆31Nov 20, 2023Updated 2 years ago
- A multimodal inference pipeline that integrates InstructBLIP with textgen-webui for Vicuna and related models.☆33Jul 14, 2023Updated 3 years ago
- Windows compile of bitsandbytes for use in text-generation-webui.☆359Nov 18, 2023Updated 2 years ago
- a dashboard for teams who use github.☆10Sep 15, 2017Updated 9 years ago
- Example about how to use to different version of the same class at the same time.☆11Jan 26, 2013Updated 13 years ago
- Xenharmlib is a music theory library for the exploration and research of microtonality, diatonic set theory, non-standard notations, and …☆15Jul 27, 2026Updated 3 months ago
- ☆31Nov 2, 2024Updated 2 years ago
- LLM-agnostic memory layer for AI agents. No embeddings, no vector DB — just fast, structured, temporal memory that any LLM can consume as…☆11Apr 27, 2026Updated 6 months ago
- Result data for the article, "Evaluating Container Platforms at Scale."☆10Mar 9, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Live demo of the Tailscale identity headers included with proxied serve requests☆12May 2, 2024Updated 2 years ago
- our django skeleton for google appengine with facebook authentication☆10Jun 30, 2010Updated 16 years ago
- ☆10Jun 14, 2016Updated 10 years ago
- 8-bit CUDA functions for PyTorch☆40May 29, 2023Updated 3 years ago
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆46Mar 21, 2024Updated 2 years ago
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆303Aug 22, 2023Updated 3 years ago
- Web application for roleplaying with AI-powered characters☆69Jul 8, 2025Updated last year