cli tool to quantize gguf, gptq, awq, hqq and exl2 models
☆77Dec 17, 2024Updated last year
Alternatives and similar repositories for quantkit
Users that are interested in quantkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple. elegant LLM Chat Inference☆27Jun 2, 2024Updated 2 years ago
- ☆16Dec 16, 2024Updated last year
- ☆27Dec 16, 2023Updated 2 years ago
- An AI tool designed to generate explanations for every file in a project☆16Mar 7, 2025Updated last year
- ☆18Jul 1, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆14Jul 2, 2025Updated last year
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated last year
- ☆15Mar 18, 2026Updated 7 months ago
- Efficient visual programming for AI language models☆357May 13, 2025Updated last year
- ☆21Jul 4, 2025Updated last year
- Cleanai (https://github.com/willmil11/cleanai) except I'm making it in c now. Fast and clean from the start this time :)☆16Jul 17, 2026Updated 3 months ago
- This is a simple HTML program to let individuals take conversational logs and change them into a conversational dataset JSON format. The …☆11Feb 25, 2024Updated 2 years ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆20Mar 14, 2025Updated last year
- Easily view and modify JSON datasets for large language models☆91May 16, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The Remdis toolkit: Building advanced real-time multimodal dialogue systems with incremental processing and large language models☆104Jun 20, 2026Updated 4 months ago
- Loader extension for tabbyAPI in SillyTavern☆27Jun 30, 2025Updated last year
- a text implementation of the HRM (Hierarchical reasoning) model (https://arxiv.org/abs/2506.21734)☆10Aug 22, 2025Updated last year
- This Streamlit application allows users to upload images and engage in interactive conversations about them using the Ollama Vision Model…☆15Nov 11, 2024Updated last year
- Inference Llama 2 in one file of pure Haskell (A port of llama2.c from Andrej Karpathy)☆14Oct 17, 2025Updated last year
- ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for s…☆12Nov 7, 2024Updated last year
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- A fork of textgen that kept some things like Exllama and old GPTQ.☆22Aug 20, 2024Updated 2 years ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆661Mar 9, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆15May 5, 2024Updated 2 years ago
- Complex RAG backend☆29Mar 28, 2024Updated 2 years ago
- Claude Code skills for hardware design, validation, and bring-up☆24Aug 2, 2026Updated 3 months ago
- A chat UI for Llama.cpp☆16Jun 4, 2026Updated 4 months ago
- ☆51Feb 19, 2025Updated last year
- ☆10Nov 7, 2025Updated 11 months ago
- PyTorch implements `Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning` paper.☆14Aug 19, 2022Updated 4 years ago
- A proof of concept model based on Llama 3.1-8B, featuring reasoning capabilities in Bulgarian.☆12Feb 9, 2025Updated last year
- LocalLLMを用いたAI小説執筆支援ツール☆30Jun 1, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A pipeline parallel training script for LLMs.☆168Apr 30, 2025Updated last year
- B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.☆26Jun 3, 2024Updated 2 years ago
- ☆15Oct 25, 2026Updated last week
- Local LLM set-up☆19Jul 1, 2024Updated 2 years ago
- plumOS-GKD☆14Nov 28, 2024Updated last year
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆25Dec 20, 2024Updated last year
- ☆22Mar 18, 2026Updated 7 months ago