TLLM_QMM strips the implementation of quantized kernels of Nvidia's TensorRT-LLM, removing NVInfer dependency and exposes ease of use Pytorch module. We modified the dequantation and weight preprocessing to align with popular quantization alogirthms such as AWQ and GPTQ, and combine them with new FP8 quantization.
☆16Jul 5, 2024Updated 2 years ago
Alternatives and similar repositories for TLLM_QMM
Users that are interested in TLLM_QMM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Jun 4, 2024Updated 2 years ago
- 中文语料：大量人工标注样本，非常有价值 ！！！☆11Aug 15, 2019Updated 7 years ago
- No pain HTML parsing library.☆12Apr 2, 2018Updated 8 years ago
- ☆27Feb 17, 2025Updated last year
- ☆13Nov 28, 2014Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Bagua tutorials.☆13Sep 4, 2022Updated 4 years ago
- Möbius Transformation for Fast Inner Product Search on Graph☆23Jun 3, 2021Updated 5 years ago
- ☆10Jun 28, 2019Updated 7 years ago
- PyTorch code for our paper "Progressive Binarization with Semi-Structured Pruning for LLMs"☆13Jul 11, 2026Updated 3 months ago
- ☆27Jan 8, 2024Updated 2 years ago
- Deep Variational Information Bottleneck (DVIB) in PyTorch.☆10Apr 25, 2020Updated 6 years ago
- 这是一款刷单平台的后台管理，主要针对商家，员工，订单，任务等进行一系列的管理☆11May 8, 2019Updated 7 years ago
- TensorRT-in-Action 是一个 GitHub 代码库，提供了使用 TensorRT 的代码示例，并有对应 Jupyter Notebook。☆15Jun 1, 2023Updated 3 years ago
- 放一些论文，简历之类的latex模板☆12Aug 4, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Mar 21, 2020Updated 6 years ago
- 16 bit serial multiplier in SystemVerilog☆13Oct 13, 2018Updated 8 years ago
- ☆12Mar 13, 2023Updated 3 years ago
- AFP is a hardware-friendly quantization framework for DNNs, which is contributed by Fangxin Liu and Wenbo Zhao.☆13Nov 8, 2021Updated 4 years ago
- Sample examples of how to call collective operation functions on multi-GPU environments. A simple example of using broadcast, reduce, all…☆36Aug 28, 2023Updated 3 years ago
- Quantize pytorch model, support post-training quantization and quantization aware training methods☆15Jun 15, 2023Updated 3 years ago
- ECE 5745 Tutorial 8: SRAM Generators☆19Mar 5, 2022Updated 4 years ago
- implement bert in pure c++☆37Apr 29, 2020Updated 6 years ago
- High performance NCCL plugin for Bagua.☆15Sep 15, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆11Jun 6, 2023Updated 3 years ago
- Pytorch implementation of RAPQ, IJCAI 2022☆23Jul 19, 2023Updated 3 years ago
- ☆13Oct 5, 2020Updated 6 years ago
- the completion of CNNs by myself☆14Oct 8, 2015Updated 11 years ago
- A c++ hash map/table which utilizes simd (specifically Intel x86 SSE/AVX)☆12Apr 30, 2019Updated 7 years ago
- A highly optimized LLM inference acceleration engine for Llama and its variants.☆907Mar 18, 2026Updated 6 months ago
- A C++-based RPC framework☆12Oct 28, 2021Updated 4 years ago
- Image to text using attention☆18Aug 30, 2017Updated 9 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆31May 13, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆22Jul 11, 2023Updated 3 years ago
- 在苏剑林老师的代码上改了一下，改成了python3.6，基于膨胀卷积，字词混合向量，radam梯度优化算法，百度百科词向量的阅读理解模型☆24Aug 28, 2019Updated 7 years ago
- Optimized Parallel Tiled Approach to perform Matrix Multiplication by taking advantage of the lower latency, higher bandwidth shared memo…☆17Sep 24, 2017Updated 9 years ago
- OneFlow Serving☆20Apr 10, 2025Updated last year
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- 各大GPU厂商以及平台商关于3D图形渲染的demo☆24Oct 6, 2026Updated last week
- SRAM☆24Sep 6, 2020Updated 6 years ago