4-bit quantization of models using GPTQ
☆18Mar 6, 2023Updated 3 years ago
Alternatives and similar repositories for GPTQ-Tools
Users that are interested in GPTQ-Tools are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code needed to reproduce results from my ICLR 2019 paper on fixed-point quantization of the backprop algorithm.☆10Jan 24, 2019Updated 7 years ago
- chap - A Python interface to chatgpt, including a terminal user interface (tui)☆16Jul 24, 2025Updated 8 months ago
- Easy-to-use Retrieval-Enhanced Transformer implementation☆10Sep 30, 2022Updated 3 years ago
- Package of useful sampling algorithms written in MLX.☆17Feb 27, 2024Updated 2 years ago
- Code for ECCV 2022 paper “Learning with Recoverable Forgetting”☆21Jul 27, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- The Codebase for Causal Distillation for Language Models (NAACL '22)☆26May 1, 2022Updated 3 years ago
- Script and instruction how to fine-tune large RWKV model on your data for Alpaca dataset☆30Apr 2, 2023Updated 3 years ago
- A Winograd based kernel for convolutions in deep learning framework☆15Jul 22, 2017Updated 8 years ago
- ☆18Apr 28, 2022Updated 3 years ago
- ☆21May 1, 2021Updated 4 years ago
- Framework for building VulkanScenGraph related projects together☆15Oct 7, 2024Updated last year
- Slack bot that indexes all messages sent in channels and can provide an interactive semantic search experience for users☆10Jan 1, 2023Updated 3 years ago
- Code for "On Long-Tailed Phenomena in NMT".☆10Jan 10, 2021Updated 5 years ago
- Collection of different types of transformers for learning purposes☆12Jan 30, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Self-host llmapi server, make it really easy for accessing LLMs !☆37Apr 7, 2023Updated 3 years ago
- stable-diffusion-webui extension that bypass to lsmith☆12Apr 28, 2023Updated 2 years ago
- A basic GUI styles.csv editor for Stable Diffusion Automatic1111 release☆12Apr 1, 2023Updated 3 years ago
- Pytorch implemntation of "Lstm: A search space odyssey" paper☆24Jan 23, 2019Updated 7 years ago
- Client side iobio library for building and executing iobio commands☆10Dec 31, 2018Updated 7 years ago
- Example of test code with Chrome Driver on OpenFin Runtime☆12Mar 10, 2023Updated 3 years ago
- This is the repo for CROssBARv2 Knowledge Graph data. CROssBARv2 is a heterogeneous general-purpose biomedical KG-based system.☆11Feb 4, 2026Updated 2 months ago
- Analysis code for knowledge discovery project☆12Sep 25, 2018Updated 7 years ago
- QQ斗地主的Demo☆13Mar 24, 2014Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 4 bits quantization of LLaMA using GPTQ☆3,072Jul 13, 2024Updated last year
- ☆11Feb 15, 2023Updated 3 years ago
- ☆12Jun 22, 2023Updated 2 years ago
- ☆15Apr 2, 2025Updated last year
- ☆10Aug 7, 2023Updated 2 years ago
- Simple CogVLM client script☆14Dec 20, 2023Updated 2 years ago
- Hybrid f0 estimation using Convolutional Neural Network☆12Apr 29, 2019Updated 6 years ago
- LightRAG with Neo4j Example Project☆17May 19, 2025Updated 11 months ago
- ☆15Oct 31, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Run multiple programs to check if a VCF is usable☆11May 15, 2020Updated 5 years ago
- CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API☆36Sep 15, 2023Updated 2 years ago
- 基于nodejs koa的微信JS-SDK通用授权服务器☆11Jan 23, 2018Updated 8 years ago
- ☆11Mar 20, 2023Updated 3 years ago
- A notebook running TensorRT's StableDiffusion demo on Google Colaboratory☆18Feb 1, 2023Updated 3 years ago
- NovelAI 5ch wikiの拡張jsのリポジトリです☆12Oct 16, 2022Updated 3 years ago
- Double precision raytracer for scientific or engineering applications.☆12May 18, 2024Updated last year