Alternatives and similar repositories for Mini_Reverse_Proxy

Users that are interested in Mini_Reverse_Proxy are comparing it to the libraries listed below

• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• cassiewilliam / cuda_op_benchmark
  方便扩展的Cuda算子理解和优化框架，仅用在学习使用
  ☆18Updated last year
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆20Updated last year
• feifeibear / PSTensor
  PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.
  ☆10Updated 3 years ago
• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆19Updated last year
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆15Updated 2 years ago
• sjtu-epcc / DVABatch
  ☆21Updated 3 years ago
• Ther-nullptr / Awesome-Transformer-Accleration
  Paper list for accleration of transformers
  ☆13Updated 2 years ago
• S-Lab-System-Group / Primo
  Primo: Practical Learning-Augmented Systems with Interpretable Models
  ☆19Updated 2 years ago
• casys-kaist / EnvPipe
  ☆25Updated 2 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated 2 years ago
• SJTU-IPADS / disb
  DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.
  ☆57Updated last year
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated last year
• LeiWang1999 / Stream-k.tvm
  ☆19Updated last year
• ruipeterpan / paper_notes
  Personal blog + reading notes on system-ish papers
  ☆15Updated 2 years ago
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆53Updated last year
• gudiandian / ElasticFlow
  ☆16Updated last year
• yuyangJin / PerFlow-AI
  PerFlow-AI is a programmable performance analysis, modeling, prediction tool for AI system.
  ☆28Updated 3 weeks ago
• BaguaSys / bagua-net
  High performance NCCL plugin for Bagua.
  ☆15Updated 4 years ago
• gofreelee / SpaceServe
  ☆24Updated 2 months ago
• ACA-Lab-SJTU / token-ring
  ☆13Updated last year
• msr-fiddle / harmony
  ☆17Updated 3 years ago
• TiledTensor / TiledLower
  TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.
  ☆14Updated last year
• wongsingfo / paper-util
  Utilities for paper writing.
  ☆12Updated 8 months ago
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆22Updated 11 months ago
• gzz2000 / RoSSH
  🛠Robust SSH: auto-reconnect SSH session that preserves your running shell and command. Intuitive, no server-side setup, aimed at simplic…
  ☆13Updated last month
• DS3Lab / DT-FM
  ☆94Updated 3 years ago
• PKUFlyingPig / Hadoop_vs_Spark
  研究生课《网络大数据管理理论和应用》大作业项目代码
  ☆13Updated 3 years ago
• lzhangbv / dear_pytorch
  [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining
  ☆12Updated 2 years ago