[NeurIPS 2024] Implementation of paper - D-LLM: A Token Adaptive Computing Resource Allocation Strategy for Large Language Models
☆23Apr 9, 2025Updated last year
Alternatives and similar repositories for D-LLM
Users that are interested in D-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PBScaler: A Bottleneck-aware Autoscaling Framework for Microservice-based Applications☆27Dec 2, 2024Updated last year
- [ICML 2025] Official implementation of the paper "SkipGPT: Dynamic Layer Pruning Reinvented with Token Awareness and Module Decoupling". …☆22Nov 17, 2025Updated 4 months ago
- ☆23Sep 6, 2024Updated last year
- Official repository of Graph RAG-Tool Fusion and ToolLinkOS dataset.☆23Feb 13, 2025Updated last year
- A pytorch model profiler with information about macs, energy and e.t.c☆17Feb 24, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆15Apr 11, 2024Updated 2 years ago
- SocksDirect code repository☆19Jun 26, 2022Updated 3 years ago
- Code repository for the IEEE VIS 2023 paper "A Comparative Visual Analytics Framework for Evaluating Evolutionary Processes in Multi-obje…☆13Jan 30, 2024Updated 2 years ago
- ☆13Apr 3, 2025Updated last year
- The code based on vLLM for the paper “ Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention”.☆11Sep 19, 2024Updated last year
- STREAMer: Benchmarking remote volatile and non-volatile memory bandwidth☆18Aug 21, 2023Updated 2 years ago
- "Learning Stable Classifiers by Transferring Unstable Features" ICML 2022☆14Jul 24, 2022Updated 3 years ago
- ☆24Dec 28, 2025Updated 3 months ago
- Density Constrained Reinforcement Learning☆12Mar 24, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The code of SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models☆22Mar 25, 2026Updated 3 weeks ago
- Bypassd is a novel I/O architecture that provides low latency access to shared SSDs.☆23May 14, 2025Updated 11 months ago
- Joint Receiver Design for Integrated Sensing and Communications (https://ieeexplore.ieee.org/document/10121420/)☆24Oct 26, 2024Updated last year
- ☆17Apr 15, 2025Updated last year
- The pmem.io Website☆17Jan 20, 2026Updated 2 months ago
- This module collects per-page stats and decide for each page if it should be migrated, replicated or interleaved.☆17Sep 29, 2015Updated 10 years ago
- INFOCOM 2024: Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inference☆34Oct 13, 2024Updated last year
- Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experiments (VIS 2024)☆27Jul 17, 2025Updated 8 months ago
- ☆19Feb 18, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 模型加速/模型压缩（已完成所有Lab）☆11Dec 24, 2023Updated 2 years ago
- Minimal implementation of Denoised Smoothing (https://arxiv.org/abs/2003.01908) in TensorFlow.☆20Aug 4, 2021Updated 4 years ago
- Implicit Distributional Actor Critic☆11Dec 8, 2021Updated 4 years ago
- Implementation of the user-space eBPF VM based on the iovisor version (https://github.com/iovisor/ubpf)☆13Apr 16, 2020Updated 6 years ago
- ☆20Sep 24, 2025Updated 6 months ago
- ☆18Jun 25, 2022Updated 3 years ago
- ☆11May 26, 2020Updated 5 years ago
- A training program for freshmem☆14Jul 29, 2021Updated 4 years ago
- A Compute Express Link (CXL) Benchmark Suite☆21Feb 12, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- TRivia: Self-supervised Fine-tuning of Vision-Language Models for Table Recognition☆30Feb 5, 2026Updated 2 months ago
- This project applies Monte Carlo Tree Search (MCTS) to a simple grid world.☆10May 30, 2018Updated 7 years ago
- Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …☆50Jun 1, 2024Updated last year
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆24Nov 21, 2024Updated last year
- ☆16Oct 18, 2023Updated 2 years ago
- Building a more intelligent world.☆11Apr 29, 2024Updated last year
- analyse problems of AI with Math and Code☆27Jul 28, 2025Updated 8 months ago