QuantLLM is a Python library designed for developers, researchers, and teams who want to fine-tune and deploy large language models (LLMs) efficiently using 4-bit and 8-bit quantization techniques.
☆17Aug 4, 2026Updated 2 months ago
Alternatives and similar repositories for QuantLLM
Users that are interested in QuantLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Nano vLLM☆15Jun 1, 2026Updated 5 months ago
- Python client SDK for Ultravox.☆17Dec 10, 2025Updated 10 months ago
- Nano vLLM v1 engine☆15Aug 6, 2025Updated last year
- This repo is a very minimal dependancy-free implementation (120 LOC) of SmolLMv2☆11Jan 29, 2025Updated last year
- A small collection of nodes intended for use with Lodestone Rock's Chroma model, for ComfyUI.☆14Jul 19, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for Looped Transformers for Length Generalization (https://arxiv.org/abs/2409.15647), ICLR 2025☆15Apr 30, 2025Updated last year
- High-performance CUDA kernels for real-time financial low latency inference, optimized for both consumer and datacenter GPUs.☆20Jul 25, 2025Updated last year
- A collection of scripts that either I'm actively working on, or have completed and shared with the community.☆14Aug 19, 2025Updated last year
- This is a Node.js Hello World example plugin☆12Feb 22, 2023Updated 3 years ago
- Put an Upnote export into a folder heirarchy☆15Jul 31, 2023Updated 3 years ago
- RLOP: A Framework for Reinforcement Learning, Optimization and Planning Algorithms☆11Aug 1, 2024Updated 2 years ago
- A free media sorter for Windows, for the moment when you realize you have gigabytes of images, audio, or videos that you created sitting …☆13Apr 10, 2026Updated 6 months ago
- Open-WebUI-Pipelines is a collection of custom pipelines for Firecrawl API, designed to enhance Open WebUI.☆16Mar 13, 2025Updated last year
- Dalamud Common Library☆13Sep 13, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- PyTorch docker images for use in GPU cloud and local environments. Includes AI-Dock base for authentication and improved user experience.☆14Jun 14, 2024Updated 2 years ago
- A Visual Question Answering Dataset for Electrical Circuit Images☆15Nov 22, 2024Updated last year
- Compiles world maps from World of Warcraft into single images☆15Oct 19, 2026Updated 2 weeks ago
- A fully local, zero-cost voice assistant with human-like expression and emotion using Orpheus TTS, LiveKit, and local LLMs. Hear your AI …☆48May 14, 2025Updated last year
- Official implementation for LaCo (EMNLP 2024 Findings)☆22Oct 3, 2024Updated 2 years ago
- A Python port of the popular https://github.com/xivapi/SaintCoinach library.☆14Oct 20, 2026Updated last week
- A Dockerfile and setup to run lollms-webui in a containerized environment☆19Sep 4, 2023Updated 3 years ago
- Localizing Memorized Sequences in Language Models☆23Oct 15, 2025Updated last year
- Parse lodestone for those juicy details☆13May 19, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Python library to parse FFXIV network event data☆14Dec 5, 2022Updated 3 years ago
- This is a Python Hello World example plugin☆13Jul 30, 2026Updated 3 months ago
- A block pruning framework for LLMs.☆28May 17, 2025Updated last year
- This is for Meridian (Traditional Chinese Medicine conception) prediction by machining learning method.☆12Sep 30, 2019Updated 7 years ago
- [DEPRECATED] Attempts to convert a Flux lora to a Chroma lora☆20Nov 9, 2025Updated 11 months ago
- Online Comment Toxicity Analysis using averaging the Classifiers and used both char level as well as word level n-grams.☆10Mar 31, 2018Updated 8 years ago
- ☆11May 28, 2024Updated 2 years ago
- FFXIV Lodestone "Eorzea Database" item id list.☆20Sep 10, 2026Updated last month
- A standalone tool that allows the user a greater degree of flexibility for making creative and interesting screenshots.☆19Aug 8, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Codes for the Nature Conservancy Fish classification challenge☆10Jan 2, 2017Updated 9 years ago
- `maid` is a Python script that aggregates content from directories and files into a single Markdown file, especially useful for creating …☆39Jan 3, 2025Updated last year
- h5涂色小游戏☆12Jan 1, 2023Updated 3 years ago
- An opinionated Visual Studio project template for Dalamud plugins, with attributes for more maintainable command setup and teardown.☆20Apr 16, 2022Updated 4 years ago
- ☆11Mar 31, 2022Updated 4 years ago
- QUANTAXIS 实盘模块☆12Jul 30, 2017Updated 9 years ago
- Generate vulnerability reports using ChatGPT automatically.使用chatGPT自动生成漏洞报告。☆12Mar 11, 2023Updated 3 years ago