Sequential Monte Carlo Speculative Decoding
☆52Aug 21, 2026Updated this week
Alternatives and similar repositories for smcsd
Users that are interested in smcsd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Elana: A Simple Energy & Latency Analyzer for LLMs☆16Apr 3, 2026Updated 4 months ago
- ☆27May 12, 2026Updated 3 months ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆23May 25, 2026Updated 2 months ago
- Developing a high-precision legal expert LLM application called Contract Advisor RAG. The project's goal is to create a Retrieval Augment…☆15Apr 10, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [NeurIPS 2025] Speculate Deep and Accurate☆24Aug 10, 2026Updated last week
- Code repository for "RL Grokking Recipe: How RL Unlocks and Transfers New Algorithms in LLMs""☆35Oct 12, 2025Updated 10 months ago
- ☆395Apr 16, 2026Updated 4 months ago
- Triton kernels for dynamic causal short convolutions.☆28Jun 4, 2026Updated 2 months ago
- Custom triton kernels for training Karpathy's nanoGPT.☆19Oct 21, 2024Updated last year
- Global CoT Analysis: Initial attempts to uncover patterns across many chains of thought☆20Feb 10, 2026Updated 6 months ago
- DFlash block-diffusion speculative decoding running on Apple Silicon via MLX, with an ANE execution path that explores heterogeneous acce…☆61Apr 18, 2026Updated 4 months ago
- ☆17Jun 15, 2026Updated 2 months ago
- Code for the papers: “Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling” and “Adaptive Block-Scaled Data Types”☆202Apr 21, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆19Oct 13, 2025Updated 10 months ago
- ☆37Jul 27, 2026Updated 3 weeks ago
- Dynamic per-token early exit for LLM inference. Skip layers tokens don't need☆33Mar 18, 2026Updated 5 months ago
- vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon☆274Jun 3, 2026Updated 2 months ago
- The official repository of Quamba1 [ICLR 2025] & Quamba2 [ICML 2025]☆70Jun 19, 2025Updated last year
- CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs☆247Updated this week
- Project code for training LLMs to write better unit tests + code☆22May 19, 2025Updated last year
- ☆65Apr 26, 2025Updated last year
- Official Project Page for HLA: Higher-order Linear Attention (https://arxiv.org/abs/2510.27258)☆103Jun 15, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆13Nov 29, 2024Updated last year
- speedrunning TFM pretraining☆48Updated this week
- [CVPR 2025] LoRA Recycle: Unlocking Tuning-Free Few-Shot Adaptability in Visual Foundation Models by Recycling Pre-Tuned LoRAs☆15Jun 20, 2025Updated last year
- Code to reproduce the experiments of the ICLR24-paper: "Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging"☆12Oct 14, 2025Updated 10 months ago
- SR²AM: Efficient Agentic Reasoning Through Self-Regulated Simulative Planning☆21May 22, 2026Updated 3 months ago
- ☆11Sep 20, 2024Updated last year
- Evalution: evolve your LLMs with better evals.☆16Updated this week
- ☆16Jul 7, 2026Updated last month
- TEVO: evolve LM motifs cheaply, then validate them in downstream train.py loops.☆19Apr 18, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- SpectralQuant: Calibrated Eigenbasis Rotation and Water-Filled Bit Allocation for KV-Cache Compression☆204May 15, 2026Updated 3 months ago
- SutroYaro — Sutro Group research workspace for energy-efficient AI training. Point any coding agent at the repo and it becomes a research…☆16May 29, 2026Updated 2 months ago
- [OSDI 2025] DecDEC: A Systems Approach to Advancing Low‑Bit LLM Quantization☆26Jan 29, 2026Updated 6 months ago
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆754Updated this week
- A Python DSL to write Nvidia PTX for Hopper and Blackwell in JAX and PyTorch☆375Jul 9, 2026Updated last month
- Probabilistic programming with large language models☆177Jun 7, 2026Updated 2 months ago
- Triton‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon☆52Mar 31, 2026Updated 4 months ago