☆16Aug 19, 2024Updated 2 years ago
Alternatives and similar repositories for decoding-speculative-decoding
Users that are interested in decoding-speculative-decoding are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆30May 24, 2025Updated last year
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆19Mar 4, 2025Updated last year
- ☆15Apr 6, 2026Updated 4 months ago
- ☆11Feb 5, 2026Updated 6 months ago
- ☆28Mar 14, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆19Jul 17, 2026Updated last month
- Multi-Candidate Speculative Decoding☆41Apr 22, 2024Updated 2 years ago
- Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"☆26Jan 27, 2025Updated last year
- From-Classification-to-Clinical☆12Apr 26, 2024Updated 2 years ago
- ☆19Mar 23, 2023Updated 3 years ago
- Decoupled Neural Interfaces Using Synthetic Gradients - under develeopment☆11Jun 27, 2025Updated last year
- Easy-to-use Retrieval-Enhanced Transformer implementation☆10Sep 30, 2022Updated 3 years ago
- Code repo for efficient quantized MoE inference with mixture of low-rank compensators☆39Apr 14, 2025Updated last year
- Thesis project about Visual Anomaly Detection based on Self Supervised Learning. The model identifies anomalies from information acquired…☆11Apr 14, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 一个小游戏☆14Aug 17, 2022Updated 4 years ago
- GPU operators for sparse tensor operations☆37Mar 11, 2024Updated 2 years ago
- GitHub Repository for KDD 2022 paper "Saliency-Regularized Deep Multi-Task Learning"☆12Sep 26, 2023Updated 2 years ago
- [ICML 2024] Sparse Model Inversion: Efficient Inversion of Vision Transformers with Less Hallucination☆14Apr 29, 2025Updated last year
- ☆14Aug 3, 2024Updated 2 years ago
- A Low-level first-order probabilistic programming language, with in built translation constraints for automatic model checking. A flexibl…☆14Apr 16, 2019Updated 7 years ago
- A demo of the Mito Streamlit Spreadsheet☆18Aug 3, 2023Updated 3 years ago
- Fast inference from large lauguage models via speculative decoding☆925Aug 22, 2024Updated 2 years ago
- ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting☆14Jun 5, 2019Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆15Jul 25, 2024Updated 2 years ago
- ☆11Apr 5, 2023Updated 3 years ago
- An Empirical Study of Memorization in NLP (ACL 2022)☆13Jun 22, 2022Updated 4 years ago
- Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.☆116Dec 2, 2024Updated last year
- demonstration for our ACL 2018 paper, "On the Practical Computational Power of Finite Precision RNNs for Language Recognition"☆11May 26, 2019Updated 7 years ago
- Various TeX templates, including slides and posters.☆16May 19, 2022Updated 4 years ago
- 해커그라운드 해커톤 2024☆12Aug 26, 2024Updated 2 years ago
- ☆16Dec 9, 2023Updated 2 years ago
- Learning Stereo Matchability in Disparity Regression Networks☆17Aug 12, 2020Updated 6 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Explorations into some recent techniques surrounding speculative decoding☆307Dec 22, 2024Updated last year
- Cluster doctor skills☆14May 23, 2026Updated 3 months ago
- ☆14Nov 15, 2022Updated 3 years ago
- Official Code for FedRule: Federated Rule Recommendation System with Graph Neural Networks☆14Sep 12, 2023Updated 2 years ago
- This is my CS 763 Computer Vision Course Project , Here we try to label Amazon Satelite Images. Here we try to implement the Show and Tel…☆12May 10, 2018Updated 8 years ago
- REST: Retrieval-Based Speculative Decoding, NAACL 2024☆221Mar 5, 2026Updated 5 months ago
- Light-weight GPU kernel interface for graph operations☆15May 20, 2020Updated 6 years ago