SuDIS-ZJU / llm-inference-all-in-oneView external linksLinks
☆17Feb 18, 2025Updated 11 months ago
Alternatives and similar repositories for llm-inference-all-in-one
Users that are interested in llm-inference-all-in-one are comparing it to the libraries listed below
Sorting:
- ☆15Jan 27, 2026Updated 3 weeks ago
- 华中师范大学ACM协会官方网站☆13Jan 2, 2026Updated last month
- ☆67Jan 26, 2026Updated 3 weeks ago
- An RDMA skew-aware key-value store, which implements the Scale-Out ccNUMA design, to exploit skew in order to increase performance of dat…☆19Jul 1, 2021Updated 4 years ago
- The Official Implementation of Ada-KV [NeurIPS 2025]☆129Nov 26, 2025Updated 2 months ago
- hadoop/mr课程的实现基于MR的贝叶斯分类器☆18Jan 26, 2020Updated 6 years ago
- Hadoop课程作业，用map/reduce实现贝叶斯文本分类器☆24Dec 7, 2021Updated 4 years ago
- The ASPLOS 2025 / EuroSys 2025 Contest Track☆39Aug 7, 2025Updated 6 months ago
- Repository of IPBench☆19Jan 4, 2026Updated last month
- LongAttn ：Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated 7 months ago
- Marathon: A Multiple-choice Long Context Evaluation Benchmark for Large Language Models.☆10May 16, 2024Updated last year
- Finetuning LLaMA with DeepSpeed☆10Apr 14, 2023Updated 2 years ago
- Code for the paper "Knowledge-Aware Federated Active Learning with Non-IID Data", ICCV2023☆10Sep 8, 2023Updated 2 years ago
- 浙江大学2025-2026学年秋冬学期 计算机网络 课程实验文档☆14Jan 30, 2026Updated 2 weeks ago
- ☆18Apr 10, 2025Updated 10 months ago
- [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning☆13Sep 2, 2024Updated last year
- Fast and memory-efficient exact attention☆18Jan 23, 2026Updated 3 weeks ago
- An Efficient Supply Chain Management System using Blockchain & Machine Learning.☆10Nov 27, 2019Updated 6 years ago
- Fine tune LLaVA 1.5 - based on article by wandb☆13Feb 19, 2024Updated last year
- ☆25Oct 11, 2025Updated 4 months ago
- Serverless LLM Inference: Deploy DeepSeek R1 & LLaMA Models on AWS Lambda with Ultra-Fast Cold Starts☆12Feb 3, 2026Updated 2 weeks ago
- ☆12Apr 9, 2025Updated 10 months ago
- Tensorflow implementation of TrialAttack (Triple Adversarial Learning for Influence based Poisoning Attack in Recommender Systems. KDD 20…☆12Sep 2, 2021Updated 4 years ago
- Code for ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context☆18Nov 15, 2024Updated last year
- Some information and some questions I have been asked during the interview.☆12Apr 15, 2022Updated 3 years ago
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆61Feb 21, 2025Updated 11 months ago
- ☆16Jul 12, 2024Updated last year
- Less Is More: Training-Free Sparse Attention with Global Locality for Efficient Reasoning☆29Sep 12, 2025Updated 5 months ago
- This is the official Python version of CoreInfer: Accelerating Large Language Model Inference with Semantics-Inspired Adaptive Sparse Act…☆17Oct 25, 2024Updated last year
- ☆15Jun 26, 2024Updated last year
- 支持GPU全链路加速的全同态加密（FHE）框架☆20Apr 18, 2025Updated 9 months ago
- Official Implementation of "GRIFFIN: Effective Token Alignment for Faster Speculative Decoding"[NeurIPS 2025]☆17May 12, 2025Updated 9 months ago
- A toolkit for modeling and simulation of cloud-native applications.☆16Aug 4, 2025Updated 6 months ago
- ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression (DAC'25)☆23Sep 15, 2025Updated 5 months ago
- [ICLR 2025] Palu: Compressing KV-Cache with Low-Rank Projection☆155Feb 20, 2025Updated 11 months ago
- 测试 https://huggingface.co/OFA-Sys/gsm8k-rft-llama7b-u13b 的 GSM8K 分数☆15Aug 10, 2023Updated 2 years ago
- ☆18Jun 3, 2024Updated last year
- [ACL 2025 (Findings)] DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling☆22Dec 16, 2024Updated last year
- Compiler development environment.☆21Nov 15, 2025Updated 3 months ago