cli tool to quantize gguf, gptq, awq, hqq and exl2 models
☆77Dec 17, 2024Updated last year
Alternatives and similar repositories for quantkit
Users that are interested in quantkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Dec 16, 2024Updated last year
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models☆40Aug 4, 2023Updated 3 years ago
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated 2 years ago
- An AI tool designed to generate explanations for every file in a project☆16Mar 7, 2025Updated last year
- ☆27Dec 16, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆14Jul 2, 2025Updated last year
- ☆15Mar 18, 2026Updated 8 months ago
- Efficient visual programming for AI language models☆358May 13, 2025Updated last year
- Cleanai (https://github.com/willmil11/cleanai) except I'm making it in c now. Fast and clean from the start this time :)☆16Jul 17, 2026Updated 4 months ago
- ☆21Jul 4, 2025Updated last year
- ☆27Sep 7, 2025Updated last year
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆20Mar 14, 2025Updated last year
- Easily view and modify JSON datasets for large language models☆91May 16, 2025Updated last year
- The Remdis toolkit: Building advanced real-time multimodal dialogue systems with incremental processing and large language models☆103Jun 20, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Loader extension for tabbyAPI in SillyTavern☆27Jun 30, 2025Updated last year
- Run text-to-video synthesis in webui.☆25Mar 20, 2023Updated 3 years ago
- A lightweight Python utility that aggregates and exports comprehensive system information to JSON, specifically designed for feeding syst…☆14Apr 13, 2025Updated last year
- a text implementation of the HRM (Hierarchical reasoning) model (https://arxiv.org/abs/2506.21734)☆10Aug 22, 2025Updated last year
- This Streamlit application allows users to upload images and engage in interactive conversations about them using the Ollama Vision Model…☆15Nov 11, 2024Updated 2 years ago
- Inference Llama 2 in one file of pure Haskell (A port of llama2.c from Andrej Karpathy)☆14Oct 17, 2025Updated last year
- ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for s…☆12Nov 7, 2024Updated 2 years ago
- A fork of textgen that kept some things like Exllama and old GPTQ.☆22Aug 20, 2024Updated 2 years ago
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆15May 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆663Mar 9, 2026Updated 8 months ago
- A chat UI for Llama.cpp☆16Jun 4, 2026Updated 5 months ago
- ☆10Nov 7, 2025Updated last year
- A proof of concept model based on Llama 3.1-8B, featuring reasoning capabilities in Bulgarian.☆12Feb 9, 2025Updated last year
- ☆51Feb 19, 2025Updated last year
- Testing Percepta's claim that transformers can execute programs via 2D convex hull attention☆11Sep 7, 2026Updated 2 months ago
- ☆66Jun 13, 2024Updated 2 years ago
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- ☆11Jul 11, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- LocalLLMを用いたAI小説執筆支援ツール☆30Jun 1, 2026Updated 5 months ago
- Local LLM set-up☆19Jul 1, 2024Updated 2 years ago
- A pipeline parallel training script for LLMs.☆169Apr 30, 2025Updated last year
- A minimal, hackable Python framework for orchestrating multi-agent LLM workflows with tools, validation, and human-in-the-loop controls—a…☆11Oct 20, 2025Updated last year
- LLM-powered research knowledge base — compile raw documents into a living wiki with persistent agent memory and RAG retrieval.☆14Apr 5, 2026Updated 7 months ago
- plumOS-GKD☆14Nov 28, 2024Updated last year
- ☆16Oct 25, 2026Updated 3 weeks ago
Are these results useful?