Alternatives and similar repositories for Mini_Reverse_Proxy

Users that are interested in Mini_Reverse_Proxy are comparing it to the libraries listed below

• PKUFlyingPig / Hadoop_vs_Spark
  研究生课《网络大数据管理理论和应用》大作业项目代码
  ☆13Updated 2 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• tile-ai / TileAttention
  ☆39Updated this week
• jiangyy / gpt-tokens
  What are learned in tiktoken?
  ☆69Updated last year
• cassiewilliam / cuda_op_benchmark
  方便扩展的Cuda算子理解和优化框架，仅用在学习使用
  ☆15Updated last year
• keith2018 / TinyGPT
  Tiny C++11 GPT-2 inference implementation from scratch
  ☆62Updated last month
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• zxytim / arithmetic-encoding-compression
  ☆11Updated 2 years ago
• thunlp / APB
  Official Implementation of APB (ACL 2025 main)
  ☆28Updated 4 months ago
• GeeeekExplorer / transformers-patch
  patches for huggingface transformers to save memory
  ☆24Updated 3 weeks ago
• microsoft / AttentionEngine
  ☆71Updated last month
• thomaschlt / mla.c
  Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.
  ☆18Updated 5 months ago
• JerryYin777 / PaperHelper
  PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References
  ☆16Updated last year
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆16Updated 7 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆40Updated last year
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆70Updated last year
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆36Updated last year
• OpenLMLab / GAOKAO-Bench-Updates
  GAOGAO-Bench-Updates is a supplement to the GAOKAO-Bench, a dataset to evaluate large language models.
  ☆31Updated 5 months ago
• ArtificialZeng / transformers-Explained
  官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。
  ☆17Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆53Updated 7 months ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated this week
• PKUCSS / arxiv-helper
  基于arxiv的论文检索和阅读工具
  ☆25Updated 3 years ago
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆47Updated 11 months ago
• jiazhihao / sosp19ae
  Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions
  ☆21Updated 3 years ago
• microsoft / FractalTensor
  FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …
  ☆26Updated 6 months ago
• wlzhao22 / tsdg
  TSDG: An efficient index graph for graph-based nearest neighbor search
  ☆9Updated 2 years ago
• mobiusml / low-rank-llama2
  Low-Rank Llama Custom Training
  ☆23Updated last year
• Ascend / torchair
  ☆14Updated this week