4 bits quantization of LLMs using GPTQ
☆48Jul 26, 2023Updated 3 years ago
Alternatives and similar repositories for GPTQ-for-LLaMa
Users that are interested in GPTQ-for-LLaMa are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆155Oct 12, 2023Updated 2 years ago
- Oobabooga extension for Bark TTS☆118Nov 23, 2023Updated 2 years ago
- A new repo to demonstrate tutorials for using HuggingFace on Graphcore IPUs.☆12May 3, 2023Updated 3 years ago
- 4 bits quantization of LLaMa using GPTQ☆12Jun 2, 2023Updated 3 years ago
- Use AI to edit your documents in real-time. Provide feedback and let the AI do all the work.☆29Jul 24, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆16Mar 24, 2023Updated 3 years ago
- An extension to Oobabooga to add a simple memory function for chat☆25Jun 5, 2023Updated 3 years ago
- A port of the RWKV v7 language model, implemented with the Burn deep learning framework☆14Jun 9, 2025Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Jul 29, 2023Updated 3 years ago
- ☆12Mar 21, 2024Updated 2 years ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆11Apr 26, 2023Updated 3 years ago
- A version of BabyAGI with numpy instead of pinecone and an evaluation agent to check success criteria☆15Apr 18, 2023Updated 3 years ago
- 8-bit CUDA functions for PyTorch☆41May 29, 2023Updated 3 years ago
- Misc. tools/scripts that I made to use for tortoise☆19Aug 19, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An AI chatbot assistant using speech recognition, text to speech, an a large language model☆14May 28, 2024Updated 2 years ago
- [OBSOLETE] Extensions API for SillyTavern.☆691Dec 10, 2024Updated last year
- A simple OpenCV webapp example☆10Jan 2, 2021Updated 5 years ago
- Hard Reload oobabooga text WebUI extensions☆20Jan 23, 2025Updated last year
- tCamView is a simple WebCam viewer software.☆24Aug 23, 2021Updated 4 years ago
- Surgically de-slop LLMs☆15Jun 1, 2025Updated last year
- An easy to use boilerplate to kickstart your Wappler project☆11May 8, 2020Updated 6 years ago
- ☆11Mar 10, 2023Updated 3 years ago
- Natural language dataset for training a Conversational Recommender System☆11Jul 9, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆42Mar 13, 2023Updated 3 years ago
- Netlist to KiCad schematic☆18Feb 8, 2021Updated 5 years ago
- Teensy Audio Library☆14Jul 20, 2020Updated 6 years ago
- Go command line app to exploit file upload vulnerability☆12Feb 8, 2017Updated 9 years ago
- ☆13Jul 12, 2024Updated 2 years ago
- ☆13Aug 6, 2024Updated 2 years ago
- Simplified installers for oobabooga/text-generation-webui.☆53Sep 16, 2023Updated 2 years ago
- An official codebase for "NormLens: Reading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Comm…☆10May 9, 2024Updated 2 years ago
- Dataset for AAAI paper "Natural Language Inference in Context - Investigating Contextual Reasoning over Long Texts"☆11Nov 18, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fast fp16-fp8 mixed precision matmul on RDNA3/3.5 GPUs without native fp8☆34Updated this week
- New version is available here: https://github.com/ImoutoChan/ImoutoRebirth☆10Jun 5, 2023Updated 3 years ago
- Implemention of "Piracy Resistant Watermarks for Deep Neural Networks" in TensorFlow.☆12Dec 5, 2020Updated 5 years ago
- Integration for Steam Audio in Bevy☆24Updated this week
- This node is base on VisualCloze method, A Universal Image Generation Framework via Visual In-Context Learning☆11May 21, 2025Updated last year
- Semantic Scaffolds for Pseudocode-to-Code Generation (accepted by ACL 2020)☆14Jun 7, 2021Updated 5 years ago
- ☆10Mar 6, 2023Updated 3 years ago