Code for Fast Ternary Large Language Model Inference with Addition-Based Sparse GEMM on Edge Devices
☆25Apr 17, 2026Updated 6 months ago
Alternatives and similar repositories for ternaryLLM
Users that are interested in ternaryLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fused MoE kernel☆23Oct 23, 2026Updated last week
- Making 1.58-bit models simple to build and broadly accessible through low-cost, high-accuracy post-training ternary quantization.☆48Aug 18, 2026Updated 2 months ago
- ☆26Oct 14, 2026Updated 2 weeks ago
- Detailed read disturbance (RowHammer and RowPress) characterization of six real HBM2 DRAM chips yielding 23 new observations and 8 new ta…☆12May 3, 2024Updated 2 years ago
- ☆15Jul 10, 2026Updated 3 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Composable HLS library for rapid development of LLM accelerators. FlexLLM enables spatial-temporal hybrid architectures, with parameteriz…☆33Aug 17, 2026Updated 2 months ago
- ☆13Oct 16, 2026Updated 2 weeks ago
- Adamas: Hadamard Sparse Attention for Efficient Long-context Inference☆15Oct 1, 2026Updated last month
- ☆18Mar 10, 2026Updated 7 months ago
- GEMMs with metal☆26Oct 17, 2026Updated 2 weeks ago
- CoalaEmbeddings: Extreme embedding compression framework—use 128x less RAM with >94% search quality.☆24Aug 15, 2026Updated 2 months ago
- Flash-Flash KDA: H100-optimized Flash Kimi Delta Attention kernels☆24Jul 24, 2026Updated 3 months ago
- Bookmarklet which pick random file containing explicit content and replaces it with something nice in your behalf.☆10Jan 7, 2023Updated 3 years ago
- BitNet a4.8 Implementation in one file of pytorch☆25Jan 13, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Feb 24, 2021Updated 5 years ago
- Fused KL divergence from hidden states for knowledge distillation☆22Apr 28, 2026Updated 6 months ago
- Official code of Discrete Forcing☆15Oct 4, 2026Updated 3 weeks ago
- A Rust Framework for Tracing, Automatic Differentiation, and Just-In-Time Compilation☆19Updated this week
- A high performance development and dispatch library for high-performance machine learning kernels.☆38Aug 15, 2026Updated 2 months ago
- [ECCV24] MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantization☆14Nov 27, 2024Updated last year
- A fruit-fly connectome (Janelia male CNS v1.0, 30,000 neurons) trained to fly an FPV drone in Liftoff, with live neural activity video☆14Oct 3, 2026Updated last month
- ☆18Mar 18, 2024Updated 2 years ago
- [NeurIPS 2025 (spotlight)] HBLLM: Wavelet-Enhanced High-Fidelity 1-Bit Quantization for LLMs☆17Dec 17, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An example OpenAI /chat/completions endpoint☆14Sep 26, 2026Updated last month
- Official Roadmap for Catalyst – Track upcoming features, improvements, and releases. Submit feature requests and help shape the future of…☆14Feb 12, 2025Updated last year
- Pruning and Distilling Mixture-of-Experts into Dense Language Models☆21Sep 2, 2026Updated 2 months ago
- Code and paper reproductions for MLPs Are Hebbians☆34Jul 22, 2026Updated 3 months ago
- ☆12Oct 13, 2025Updated last year
- A wrapper framework built atop PyTorch to simulate the use of custom/mixed precision arithmetic in DNN training and inference workloads.☆12Oct 16, 2026Updated 2 weeks ago
- Java OCR☆16Jul 19, 2026Updated 3 months ago
- Bringing StableHLO to Apple Silicon☆26Oct 12, 2026Updated 3 weeks ago
- [ICLR 2023] PyTorch code for DFPC: Data flow driven pruning of coupled channels without data.☆15Aug 25, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆15Mar 21, 2025Updated last year
- JAX support for tvm-ffi abi☆28May 14, 2026Updated 5 months ago
- Fast inference for Kyutai's Mimi neural audio codec☆20Aug 31, 2026Updated 2 months ago
- Convert StableHLO models into Apple Core ML format☆22Sep 12, 2026Updated last month
- ☆25Aug 26, 2025Updated last year
- Arche is a Greek word with primary senses "beginning". The repository defines a framework for technology mapping of emerging technologies…☆11May 15, 2020Updated 6 years ago
- ☆14Nov 15, 2024Updated last year