4 bits quantization of LLMs using GPTQ
☆48Jul 26, 2023Updated 3 years ago
Alternatives and similar repositories for GPTQ-for-LLaMa
Users that are interested in GPTQ-for-LLaMa are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Oobabooga extension for Bark TTS☆118Nov 23, 2023Updated 2 years ago
- A new repo to demonstrate tutorials for using HuggingFace on Graphcore IPUs.☆12May 3, 2023Updated 3 years ago
- Use AI to edit your documents in real-time. Provide feedback and let the AI do all the work.☆29Jul 24, 2024Updated 2 years ago
- An extension to Oobabooga to add a simple memory function for chat☆25Jun 5, 2023Updated 3 years ago
- A port of the RWKV v7 language model, implemented with the Burn deep learning framework☆14Jun 9, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Jul 29, 2023Updated 3 years ago
- A Sensor Streamer for Android Wear OS☆19Feb 9, 2024Updated 2 years ago
- ☆12Mar 21, 2024Updated 2 years ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆11Apr 26, 2023Updated 3 years ago
- ☆11May 14, 2023Updated 3 years ago
- A version of BabyAGI with numpy instead of pinecone and an evaluation agent to check success criteria☆15Apr 18, 2023Updated 3 years ago
- Node based graph editor for Dear ImGui☆17Jan 2, 2024Updated 2 years ago
- Discord integration for the oobabooga's text-generation-webui☆13Apr 27, 2023Updated 3 years ago
- Misc. tools/scripts that I made to use for tortoise☆19Aug 19, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [OBSOLETE] Extensions API for SillyTavern.☆701Dec 10, 2024Updated last year
- Image Diffusion block merging technique applied to transformers based Language Models.☆55May 8, 2023Updated 3 years ago
- Hard Reload oobabooga text WebUI extensions☆20Jan 23, 2025Updated last year
- A Next.js chatbot app demonstrating seamless integration with window.ai.☆16Jun 25, 2023Updated 3 years ago
- ☆16Jun 6, 2023Updated 3 years ago
- Minimal vi-like text editor☆18Sep 21, 2019Updated 6 years ago
- An easy to use boilerplate to kickstart your Wappler project☆11May 8, 2020Updated 6 years ago
- ☆11Mar 10, 2023Updated 3 years ago
- ☆18Nov 10, 2015Updated 10 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆42Mar 13, 2023Updated 3 years ago
- Dataset for AAAI paper "Natural Language Inference in Context - Investigating Contextual Reasoning over Long Texts"☆11Nov 18, 2022Updated 3 years ago
- ☆15Dec 5, 2025Updated 9 months ago
- commandline linux usbmon interface☆19Sep 24, 2014Updated 11 years ago
- New version is available here: https://github.com/ImoutoChan/ImoutoRebirth☆10Jun 5, 2023Updated 3 years ago
- Implemention of "Piracy Resistant Watermarks for Deep Neural Networks" in TensorFlow.☆12Dec 5, 2020Updated 5 years ago
- Codebase for the arxiver dataset☆14Nov 29, 2024Updated last year
- This node is base on VisualCloze method, A Universal Image Generation Framework via Visual In-Context Learning☆11May 21, 2025Updated last year
- Static website generator that is simple to use☆12Dec 17, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Fluentd output plugin that sends events to Amazon Kinesis Streams and Amazon Kinesis Firehose.☆12Apr 2, 2023Updated 3 years ago
- A simple extension that uses Bark Text-to-Speech for audio output☆10Nov 20, 2023Updated 2 years ago
- ☆15Oct 17, 2023Updated 2 years ago
- ☆40Mar 25, 2023Updated 3 years ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- [ACL 2024] Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models☆49Jun 4, 2024Updated 2 years ago
- Lint your code against Mantra spec (work in progress)☆12Apr 12, 2016Updated 10 years ago