Code for Fast Ternary Large Language Model Inference with Addition-Based Sparse GEMM on Edge Devices
☆24Apr 17, 2026Updated 5 months ago
Alternatives and similar repositories for ternaryLLM
Users that are interested in ternaryLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Oct 8, 2016Updated 10 years ago
- Code for Hutch++: Optimal Stochastic Trace Estimation☆13Aug 30, 2021Updated 5 years ago
- BitNet a4.8 Implementation in one file of pytorch☆26Jan 13, 2025Updated last year
- Spire is a Python embedded domain-specific language (DSL) for RTL generation. Its built-in optimizations reduce area and delay of circuit…☆44Oct 6, 2026Updated last week
- Rust bindings for CTranslate2☆14Jun 21, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Pure Java Llama2 inference with optional multi-GPU CUDA implementation☆15Sep 2, 2023Updated 3 years ago
- Pythonic interface and JIT compiler for https://gitcode.com/cann/pto-isa☆28Jun 1, 2026Updated 4 months ago
- [ECCV24] MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization☆14Nov 27, 2024Updated last year
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆28Mar 22, 2026Updated 6 months ago
- ☆21Apr 3, 2025Updated last year
- Official Roadmap for Catalyst – Track upcoming features, improvements, and releases. Submit feature requests and help shape the future of…☆14Feb 12, 2025Updated last year
- ☆23Oct 24, 2022Updated 3 years ago
- ☆28Jul 1, 2026Updated 3 months ago
- BGEMM-CUDA is a CUDA-based low-bit GEMM kernel library for efficient neural network inference. It implements optimized binary and ternary…☆21Aug 30, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 基于vits与softvc的歌声音色转换模型☆12Jan 9, 2023Updated 3 years ago
- Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"☆24Updated this week
- An open-sourced PyTorch library for developing energy efficient multiplication-less models and applications.☆14Feb 3, 2025Updated last year
- This is the Google/EFabless/Skywater Caravel submission of an Analog Spiking Neuron Circuit. The submission also includes a SONOS transis…☆12Apr 21, 2023Updated 3 years ago
- Arche is a Greek word with primary senses "beginning". The repository defines a framework for technology mapping of emerging technologies…☆11May 15, 2020Updated 6 years ago
- ☆14Oct 11, 2024Updated 2 years ago
- Code for ICML 2022 paper "SPDY: Accurate Pruning with Speedup Guarantees"☆20May 3, 2023Updated 3 years ago
- Programmable voice assistant☆15Dec 17, 2016Updated 9 years ago
- DUTH RISC V Microprocessor for High Level Synthesis☆10Jun 23, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An implementation of a quantum neural network built using pyquil.☆11Jun 7, 2019Updated 7 years ago
- This repository integrates gem5 with Ramulator2, allowing gem5 to use Ramulator2 as its DRAM memory model. With the provided materials an…☆14Jun 7, 2025Updated last year
- DeepGate3 for ICCAD2024☆14May 26, 2025Updated last year
- SIMPLE MAGIC: Synthesis and In-memory MaPping of Logic Execution for Memristor Aided loGIC☆15Jan 23, 2020Updated 6 years ago
- You can using Streamv2v in ComfyUI☆12Sep 6, 2024Updated 2 years ago
- Energy-based Hallucination detection.☆25Mar 3, 2026Updated 7 months ago
- ☆10Apr 22, 2021Updated 5 years ago
- Standalone commandline CLI tool for compiling Triton kernels☆20Sep 13, 2024Updated 2 years ago
- Deep Dependency Representation☆16May 9, 2018Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Accelerate multihead attention transformer model using HLS for FPGA☆13Dec 7, 2023Updated 2 years ago
- Create synthetic datasets from scratch using AI-powered generation. Define topics, customize prompts, and generate high-quality reasoning…☆32Jul 23, 2026Updated 2 months ago
- ☆14Oct 22, 2023Updated 2 years ago
- A multisend smart contract for the Terra blockchain using CosmWasm☆16Sep 30, 2020Updated 6 years ago
- ☆10Feb 8, 2023Updated 3 years ago
- Playing with CSM☆23Mar 14, 2025Updated last year
- An Open-Source Processor for Accelerating Spiking Neural Network☆14Sep 30, 2022Updated 4 years ago