The speculative decoding for uav environment
☆16Oct 18, 2025Updated last year
Alternatives and similar repositories for DSSD-Efficient-Edge-Computing
Users that are interested in DSSD-Efficient-Edge-Computing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Jupiter is a fast, scalable, and resource-efficient collaborative edge-AI system for generative LLM inference.☆33Jul 3, 2026Updated 4 months ago
- Continuous Pipelined Speculative Decoding☆22May 25, 2026Updated 5 months ago
- Mesh: A lightweight, distributed, relational network architecture for MPC☆12Apr 2, 2026Updated 7 months ago
- [ACL 26 Findings] LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation☆13Apr 21, 2026Updated 6 months ago
- ☆11Jun 19, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- EC-LLM: Low-cost, Low-latency, High-quality Large Language Model Inference Based on Edge-cloud Collaboration☆12Jun 18, 2024Updated 2 years ago
- ☆18Nov 28, 2024Updated last year
- Greed is Good: Exploration and Exploitation Trade-offs in Bayesian Optimisation☆10May 20, 2021Updated 5 years ago
- ☆20Mar 18, 2026Updated 8 months ago
- ☆17May 10, 2024Updated 2 years ago
- The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"☆17Mar 17, 2025Updated last year
- Accepted by NAACL 2025 main conference.☆11Jan 24, 2025Updated last year
- GlimpRouter: Efficient Collaborative Inference by Glimpsing One Token of Thoughts☆21Apr 24, 2026Updated 6 months ago
- ☆19Aug 16, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Local DeepSearch (Advantage: Low Threshold): an implementation of Agentic RAG based on DeepSeek-R1 API and Tavily API☆18Jun 21, 2025Updated last year
- Learning to Skip the Middle Layers of Transformers☆17Aug 7, 2025Updated last year
- ☆13Jul 9, 2024Updated 2 years ago
- This project explores training data extraction attacks on the LLaMa 7B, GPT-2XL, and GPT-2-IMDB models to discover memorized content usin…☆15Jun 15, 2023Updated 3 years ago
- The fastest off-the-shelf inference algorithm for LLMs (ICLR’25)☆14Mar 8, 2025Updated last year
- software for CSI data generation based on ray tracing☆12Jul 31, 2026Updated 3 months ago
- This project is based on DeepSeek's latest R1 1.5B model, deployed for inference on the Ascend Atlas 200I DK A2 device. The model has bee…☆16Feb 19, 2025Updated last year
- ☆13Feb 22, 2023Updated 3 years ago
- ☆18Sep 6, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [AAAI2026] Official repo for paper "PRISM: Privacy-Aware Routing for Adaptive Cloud–Edge LLM Inference via Semantic Sketch Collaboration"☆28Jul 16, 2026Updated 4 months ago
- ☆19Nov 7, 2026Updated last week
- Cascade Speculative Drafting☆32Apr 2, 2024Updated 2 years ago
- Adapt full attention LLM to sliding window attention☆14Feb 20, 2026Updated 8 months ago
- ☆31Nov 4, 2026Updated 2 weeks ago
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆100Oct 15, 2025Updated last year
- Artifact for "Fail Fast, Win Big: Rethinking the Drafting Strategy in Speculative Decoding via Diffusion LLMs" [arXiv '25]☆21Jul 26, 2026Updated 3 months ago
- ☆21Oct 22, 2025Updated last year
- A simple implementation of DP-RAG☆21Mar 17, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆19Sep 26, 2026Updated last month
- EMNLP 2025☆14Nov 28, 2024Updated last year
- Code release for AdapMoE accepted by ICCAD 2024☆40Apr 28, 2025Updated last year
- Yet Another LLM Inference System☆18Mar 1, 2026Updated 8 months ago
- AutoWeka for python☆29May 13, 2014Updated 12 years ago
- [ICML 2025] AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism☆20Jul 14, 2025Updated last year
- Statistical Channel Based Low-Complexity Rotation and Position Optimization for 6D Movable Antennas Enabled Wireless Communication☆17Apr 30, 2025Updated last year
Are these results useful?