Serving LLMs on heterogeneous decentralized clusters.
☆11Nov 30, 2023Updated 2 years ago
Alternatives and similar repositories for HexGen
Users that are interested in HexGen are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆41Aug 29, 2025Updated last year
- Multi-branch model for concurrent execution☆18Jun 27, 2023Updated 3 years ago
- Al Quran is the holy book of Islam. Muslims believe that the Quran was revealed by Allah (SWT) to the final prophet & messenger, Muhammad…☆12Apr 30, 2023Updated 3 years ago
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆43Jan 31, 2024Updated 2 years ago
- code for EMNLP 2024 paper: Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysis☆12Nov 17, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Lumos, a decision-tree-based throughput predictor for adaptive streaming - IEEE INFOCOM 2022 & IEEE TMC 2023☆12Jan 3, 2024Updated 2 years ago
- Experimental Deep Learning for Code Generation Processes☆13Jan 20, 2019Updated 7 years ago
- One-click rooting and KernelSU-Next tool for the Samsung SCR-01 mobile 5G router.☆33Updated this week
- 🍨 An Enhancement for the Official Scoop Extras Bucket 🍨☆13Updated this week
- This repository contains the implementation of the paper "RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-…☆23May 15, 2026Updated 5 months ago
- ☆11Dec 17, 2021Updated 4 years ago
- ICML 2024 - Self-Driven Entropy Aggregation for Byzantine-Robust Heterogeneous Federated Learning☆11Jul 16, 2024Updated 2 years ago
- Structure From Motion☆10Nov 22, 2022Updated 3 years ago
- ☆16Oct 4, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [SIGCOMM 2023] PacketGame: Multi-Stream Packet Gating for Concurrent Video Inference at Scale☆15Jul 1, 2023Updated 3 years ago
- Plato is a system for viewport adaptation based bitrate adaptive VR video streaming.☆15May 1, 2018Updated 8 years ago
- 中文自然语言处理☆11Apr 4, 2019Updated 7 years ago
- [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.☆37May 6, 2024Updated 2 years ago
- ☆12Jul 30, 2025Updated last year
- [MICCAI 2025 Early Accept] Holistic White-light Polyp Classification via Alignment-free Dense Distillation of Auxiliary Optical Chromoend…☆11Dec 5, 2025Updated 10 months ago
- Code and results for "Revisiting RaBitQ and TurboQuant: a symmetric comparison of methods, theory, and experiments".☆13Aug 1, 2026Updated 2 months ago
- The repo for the article: CSPG: Crossing Sparse Proximity Graphs for Approximate Nearest Neighbor Search☆12Dec 12, 2024Updated last year
- 适配handsome主题的追番页面，基于原作者插件做了性能优化☆10Mar 25, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of the BLE neighbor discovery simulation framework in paper "Blender: Toward Practical Simulation Framework for BLE Neighb…☆15Feb 7, 2023Updated 3 years ago
- The Easiest Pytorch Implementation of Branching-DQN☆12Feb 10, 2021Updated 5 years ago
- 【NeurIPS 2021 Spotlight】 "Torwards Gradient-based Bilevel Optimization with non-convex Followers and Beyond"☆11Mar 28, 2022Updated 4 years ago
- 中山大学体育场馆管理与预定系统助手☆26Apr 9, 2021Updated 5 years ago
- Implementation of Model-Distributed Inference for Large Language Models, built on top of LitGPT☆15Aug 26, 2025Updated last year
- ☆44Sep 19, 2023Updated 3 years ago
- This repo hosts the famfs kernel patch sets as branches☆11Mar 24, 2026Updated 7 months ago
- 对输入的图像（含有人脸）进行模糊或像素化处理☆10Jan 9, 2021Updated 5 years ago
- Official PyTorch implementation for the ICML 2023 paper "Out-of-Distribution Generalization of Federated Learning via Implicit Invariant …☆14Oct 31, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [MobiCom '23] AccuMO: Accuracy-Centric Multitask Offloading in Edge-Assisted Mobile Augmented Reality☆17Oct 8, 2023Updated 3 years ago
- ☆26Sep 17, 2024Updated 2 years ago
- Rcmp: Reconstructing RDMA-based Memory Disaggregation via CXL☆64Dec 26, 2023Updated 2 years ago
- Auto-Split: A General Framework of Collaborative Edge-Cloud AI☆14Aug 31, 2021Updated 5 years ago
- A code base for Vexless☆17Mar 7, 2024Updated 2 years ago
- A prototyping environment that runs an emulated NVMe device☆13Oct 6, 2017Updated 9 years ago
- Model Parallelism for pytorch training multiple network on multiple GPUs.☆28Mar 24, 2018Updated 8 years ago