The speculative decoding for uav environment
☆17Oct 18, 2025Updated 11 months ago
Alternatives and similar repositories for DSSD-Efficient-Edge-Computing
Users that are interested in DSSD-Efficient-Edge-Computing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Jupiter is a fast, scalable, and resource-efficient collaborative edge-AI system for generative LLM inference.☆32Jul 3, 2026Updated 3 months ago
- Continuous Pipelined Speculative Decoding☆22May 25, 2026Updated 4 months ago
- This project explores training data extraction attacks on the LLaMa 7B, GPT-2XL, and GPT-2-IMDB models to discover memorized content usin…☆15Jun 15, 2023Updated 3 years ago
- Greed is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation☆10May 20, 2021Updated 5 years ago
- ☆17May 10, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆20Mar 18, 2026Updated 6 months ago
- Local DeepSearch (Advantage: Low Threshold): an implementation of Agentic RAG based on DeepSeek-R1 API and Tavily API☆18Jun 21, 2025Updated last year
- The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"☆17Mar 17, 2025Updated last year
- Learning to Skip the Middle Layers of Transformers☆17Aug 7, 2025Updated last year
- Official repository for PEFTGuard: Detecting Backdoor Attacks Against Parameter-Efficient Fine-Tuning, accepted at 2025 IEEE Symposium on…☆19Jul 4, 2025Updated last year
- CCLoco: Scaling Up Top-K Error Feedback with Local Optimizers☆27Aug 22, 2025Updated last year
- Scalable Edge-Assisted Serving Framework for Interactive LLMs [NeurIPS 2025 Spotlight]☆36Nov 14, 2025Updated 10 months ago
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆19Mar 4, 2025Updated last year
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆97Oct 15, 2025Updated 11 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [ICML 2025] AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism☆20Jul 14, 2025Updated last year
- Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)☆47Dec 9, 2023Updated 2 years ago
- 数学分析、高等代数、抽象、泛函、实变、复变、常微、☆32Jul 2, 2025Updated last year
- ☆35Dec 17, 2018Updated 7 years ago
- For distributed machine learning☆33Mar 2, 2026Updated 7 months ago
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆1,299Jun 27, 2026Updated 3 months ago
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆38May 6, 2024Updated 2 years ago
- ☆42Jun 23, 2026Updated 3 months ago
- ☆49Jun 27, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆69Nov 4, 2024Updated last year
- ☆38Jul 21, 2025Updated last year
- Collection of tools and resources for managing the statistical disclosure control of trained machine learning models☆40Updated this week
- [ICLR 2025, IEEE TPAMI 2026] Mixture Compressor & MC#☆79Feb 12, 2025Updated last year
- D^2-MoE: Delta Decompression for MoE-based LLMs Compression☆86Mar 25, 2025Updated last year
- [ECCV 2026🔥] This is the official implementation of our paper "SpecEyes: Accelerating Agentic Multimodal LLMs via Speculative Perception…☆68Apr 2, 2026Updated 6 months ago
- Code for the CCS'22 paper "Federated Boosted Decision Trees with Differential Privacy"☆58Oct 19, 2023Updated 2 years ago
- [TDSC 2025] InferDPT: Privacy-Preserving Inference for Closed-box Large Language Model☆46Nov 16, 2025Updated 10 months ago
- personal implementation of secure aggregation protocol☆44Feb 6, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆35Aug 18, 2023Updated 3 years ago
- [NeurIPS 2025] Official Implementation of ViSpec: Accelerating Vision-Language Models with Vision-Aware Speculative Decoding.☆71Jan 28, 2026Updated 8 months ago
- ☆65Mar 11, 2025Updated last year
- DeepCC: A Deep Reinforcement Learning Plug-in to Boost the performance of your TCP scheme in Cellular Networks!☆33Jun 18, 2022Updated 4 years ago
- [NeurIPS'23] Speculative Decoding with Big Little Decoder☆99Feb 6, 2024Updated 2 years ago
- Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.☆116Dec 2, 2024Updated last year
- ☆114Jun 15, 2025Updated last year