Scalable Edge-Assisted Serving Framework for Interactive LLMs [NeurIPS 2025 Spotlight]
☆39Nov 14, 2025Updated last year
Alternatives and similar repositories for specedge
Users that are interested in specedge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of the paper: Decomposing Vision Transformers for Collaborative Inference in Edge Devices☆18Jul 27, 2024Updated 2 years ago
- ☆12Oct 13, 2025Updated last year
- Accelerate Video Diffusion Inference via Sketching-Rendering Cooperation☆20Jun 11, 2025Updated last year
- ☆13Jun 15, 2020Updated 6 years ago
- Programming for AI Practice☆14Dec 13, 2020Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)☆47Dec 9, 2023Updated 2 years ago
- User-friendly multi-turn image editing☆20Aug 25, 2025Updated last year
- ☆13Jan 7, 2025Updated last year
- ☆71Nov 4, 2024Updated 2 years ago
- (COLING2025) SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding☆10Dec 18, 2024Updated last year
- This is an official GitHub repository for the paper, "NEMO: Enabling Neural-enhanced Video Streaming on Commodity Mobile Devices".☆81Jan 28, 2022Updated 4 years ago
- FlowPrefill: Decoupling Preemption from Prefill Scheduling Granularity to Mitigate Head-of-Line Blocking in LLM Serving☆12Aug 3, 2026Updated 3 months ago
- ☆19May 16, 2026Updated 6 months ago
- ☆22Sep 11, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- LotteryFL: Empower Edge Intelligence with Personalized and Communication-Efficient Federated Learning (2021 IEEE/ACM Symposium on Edge Co…☆42Nov 16, 2022Updated 4 years ago
- The speculative decoding for uav environment☆16Oct 18, 2025Updated last year
- Official Implementation code for PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity (IC…☆11Aug 1, 2025Updated last year
- Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.☆117Dec 2, 2024Updated last year
- ☆12Feb 1, 2023Updated 3 years ago
- CCLoco: Scaling Up Top-K Error Feedback with Local Optimizers☆29Aug 22, 2025Updated last year
- A few simple example projects demonstrating how to use some core features of STM32 UART peripherals.☆15Jul 24, 2022Updated 4 years ago
- ☆12Mar 21, 2024Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆14Mar 7, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- PFLoRA-lib: Personalized Federated Learning with LoRA Algorithm Library focusing on privacy-protection, federated-learning, Citation, Ext…☆14Sep 19, 2024Updated 2 years ago
- Code for Generalization Guarantees for (Multi-Modal) Imitation Learning☆11Jul 14, 2022Updated 4 years ago
- An image retrieval engine . 图像检索系统。☆10Jan 11, 2024Updated 2 years ago
- ☆13May 20, 2026Updated 5 months ago
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆1,309Jun 27, 2026Updated 4 months ago
- ☆12May 19, 2025Updated last year
- Code for PEEK: Guiding and Minimal Image Representations for Zero-Shot Generalization of Robot Manipulation Policies☆14Feb 15, 2026Updated 9 months ago
- Code of the paper: Debiasing Meta-Gradient Reinforcement Learning by Learning the Outer Value Function☆13Apr 13, 2026Updated 7 months ago
- About Official PyTorch(MMCV) implementation of “SUMix: Mixup with Semantic and Uncertain Information” (ECCV 2024)☆12Sep 2, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fast, memory-efficient Butina clustering and dataset splitting for chemical fingerprints☆12Jun 4, 2026Updated 5 months ago
- Layered prefill changes the scheduling axis from tokens to layers and removes redundant MoE weight reloads while keeping decode stall fre…☆24Mar 9, 2026Updated 8 months ago
- Optimizing the Pairs-Trading Strategy using Deep Reinforcement Learning with Trading and Stop-loss Boundaries☆12Dec 12, 2021Updated 4 years ago
- Official implementation of DapperFL.☆13Oct 29, 2024Updated 2 years ago
- An (updated and expanded) rigorous, well documented machine learning analysis pipeline for binary classification datasets assembled as a …☆11Jun 16, 2021Updated 5 years ago
- Partial implementation of paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING"☆33Nov 20, 2020Updated 5 years ago
- Understanding Self-Supervised Learning in a non-IID Setting☆21Oct 21, 2022Updated 4 years ago
Are these results useful?