Code for Fast Ternary Large Language Model Inference with Addition-Based Sparse GEMM on Edge Devices
☆17Apr 17, 2026Updated 3 months ago
Alternatives and similar repositories for ternaryLLM
Users that are interested in ternaryLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15May 19, 2026Updated 2 months ago
- Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free…☆24Aug 4, 2026Updated last week
- Spire is a Python embedded domain-specific language (DSL) for RTL generation. Its built-in optimizations reduce area and delay of circuit…☆36Aug 3, 2026Updated last week
- Shiftly is an Android app which provides an easy and interactive way for both employers and employees to manage scheduling at work.☆10Sep 24, 2019Updated 6 years ago
- ROS package to allow starting and stopping of rosbag recordings via service calls.☆10Mar 5, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ECCV24] MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization☆14Nov 27, 2024Updated last year
- Testing Difference Target Propagation (DTP) on MNIST.☆13Oct 12, 2020Updated 5 years ago
- [NeurIPS 2025 (spotlight)] HBLLM: Wavelet-Enhanced High-Fidelity 1-Bit Quantization for LLMs☆16Dec 17, 2025Updated 7 months ago
- ☆15Mar 21, 2025Updated last year
- ☆15Jul 9, 2026Updated last month
- This repo implements Video generation model using Latent Diffusion Transformers(Latte) in PyTorch and provides training and inference cod…☆19Jan 6, 2025Updated last year
- Free, open-source community platform, decentralized alternative to Big Tech. For apps that empower people and unite communities.☆20Updated this week
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆28Mar 22, 2026Updated 4 months ago
- To appear in the 11th International Conference on Learning Representations (ICLR 2023).☆18Feb 24, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆21Apr 3, 2025Updated last year
- [ICLR 2023] PyTorch code for DFPC: Data flow driven pruning of coupled channels without data.☆15Aug 25, 2023Updated 2 years ago
- ☆14Jan 6, 2021Updated 5 years ago
- ☆22Jul 1, 2026Updated last month
- BGEMM-CUDA is a CUDA-based low-bit GEMM kernel library for efficient neural network inference. It implements optimized binary and ternary…☆20Aug 30, 2024Updated last year
- 基于vits与softvc的歌声音色转换模型☆12Jan 9, 2023Updated 3 years ago
- Manuscripts descriptions☆17Updated this week
- ☆22May 26, 2025Updated last year
- ☆15Mar 20, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention☆57Aug 6, 2025Updated last year
- dynamic planning, hybrid models, hierarchical active inference, tool use☆15Jun 13, 2025Updated last year
- DUTH RISC V Microprocessor for High Level Synthesis☆10Jun 23, 2023Updated 3 years ago
- An implementation of a quantum neural network built using pyquil.☆11Jun 7, 2019Updated 7 years ago
- This repository integrates gem5 with Ramulator2, allowing gem5 to use Ramulator2 as its DRAM memory model. With the provided materials an…☆14Jun 7, 2025Updated last year
- PyTorch Tools for Synthetic Aperture Radar.☆14Jul 3, 2022Updated 4 years ago
- You can using Streamv2v in ComfyUI☆12Sep 6, 2024Updated last year
- Energy-based Hallucination detection.☆25Mar 3, 2026Updated 5 months ago
- Deep Q Reinforcement learning to play games just from visual input.☆10Sep 14, 2020Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- React application using Segment Anything in browser☆10Oct 9, 2023Updated 2 years ago
- 在ChatGPT-Next-Web的基础上，增加注册登录，额度限制，邀请，敏感词，支付，基于docker一键部署。提供后台管理系统，可配置标题、欢迎词、额度不足提醒、公告http://aisuperhero.xyz☆10May 7, 2024Updated 2 years ago
- A small collection of custom nodes for use with ComfyUI, for geometry calculations☆13Sep 30, 2024Updated last year
- Accelerate multihead attention transformer model using HLS for FPGA☆13Dec 7, 2023Updated 2 years ago
- ☆26Mar 1, 2024Updated 2 years ago
- Create synthetic datasets from scratch using AI-powered generation. Define topics, customize prompts, and generate high-quality reasoning…☆32Jul 23, 2026Updated 2 weeks ago
- ☆11Mar 12, 2021Updated 5 years ago