Sequential Monte Carlo Speculative Decoding
☆54Aug 25, 2026Updated last month
Alternatives and similar repositories for smcsd
Users that are interested in smcsd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- UniQL official repository (ICLR 2026)☆19Jan 27, 2026Updated 8 months ago
- Elana: A Simple Energy & Latency Analyzer for LLMs☆16Apr 3, 2026Updated 6 months ago
- ☆27May 12, 2026Updated 5 months ago
- This repository contains code for the paper "Better Estimation of the KL Divergence Between Language Models"☆20May 30, 2025Updated last year
- Scripts for training Qwen 2.5 VL with ms-swift and GRPO☆13Feb 27, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆38Jul 27, 2026Updated 2 months ago
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆24May 25, 2026Updated 4 months ago
- ☆14Apr 13, 2026Updated 6 months ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Updated this week
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 6 months ago
- ☆21Aug 17, 2026Updated 2 months ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- Developing a high-precision legal expert LLM application called Contract Advisor RAG. The project's goal is to create a Retrieval Augment…☆15Apr 10, 2024Updated 2 years ago
- ☆397Apr 16, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [NeurIPS 2025] Speculate Deep and Accurate☆25Aug 10, 2026Updated 2 months ago
- Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).☆62Sep 26, 2026Updated 3 weeks ago
- Tile primitives for speedy kernels☆21Sep 13, 2026Updated last month
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 6 months ago
- Global CoT Analysis: Initial attempts to uncover patterns across many chains of thought☆20Feb 10, 2026Updated 8 months ago
- Implementation of M2PT in PyTorch from the paper: "Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities"☆14Mar 11, 2024Updated 2 years ago
- alternative way to calculating self attention☆18May 25, 2024Updated 2 years ago
- Code for the papers: “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling” and “Adaptive Block-Scaled Data Types”☆206Apr 21, 2026Updated 6 months ago
- ☆37Mar 27, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated mod…☆46Jun 7, 2026Updated 4 months ago
- vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon☆274Jun 3, 2026Updated 4 months ago
- Dynamic per-token early exit for LLM inference. Skip layers tokens don't need☆34Sep 18, 2026Updated last month
- ☆17Jun 15, 2026Updated 4 months ago
- ☆19Oct 13, 2025Updated last year
- ☆27Aug 15, 2026Updated 2 months ago
- Truthful scheduler-step and streaming visualization for local LLM inference☆35Sep 6, 2026Updated last month
- ☆32May 15, 2026Updated 5 months ago
- Project code for training LLMs to write better unit tests + code☆22May 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆65Apr 26, 2025Updated last year
- Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"☆13Jan 27, 2025Updated last year
- Official Project Page for HLA: Higher-order Linear Attention (https://arxiv.org/abs/2510.27258)☆104Jun 15, 2026Updated 4 months ago
- CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs☆256Oct 15, 2026Updated last week
- ☆54Jun 2, 2026Updated 4 months ago
- Interactive 3D model of NVIDIA Vera Rubin hardware (superchip, NVL72 compute tray, HGX NVL8) with connection tracing and a guided tour☆16Oct 1, 2026Updated 3 weeks ago
- Learning notes for understanding modern Machine Learning System.☆64Updated this week