Alternatives and similar repositories for CleanParallel:

Users that are interested in CleanParallel are comparing it to the libraries listed below

• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆45Updated last year
• Sunt-ing / stick
  A PyTorch-like deep learning framework. Just for fun.
  ☆145Updated last year
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆51Updated 7 months ago
• hongzhangblaze / CS854-F24
  ☆35Updated 4 months ago
• JF-D / Parcae
  ☆14Updated 10 months ago
• LoongServe / LoongServe
  ☆87Updated 4 months ago
• MoE-Inf / awesome-moe-inference
  Curated collection of papers in MoE model inference
  ☆93Updated 3 weeks ago
• Relaxed-System-Lab / HexGen
  [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.
  ☆22Updated 10 months ago
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …
  ☆28Updated 9 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆79Updated 2 months ago
• pku-liang / ArkVale
  ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
  ☆30Updated 2 months ago
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆129Updated last year
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆82Updated last year
• ZhangJingrong / gpu_topK_benchmark
  GPU TopK Benchmark
  ☆14Updated 2 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆101Updated last month
• Hsword / Awesome-Machine-Learning-System-Papers
  ☆67Updated 3 years ago
• HarryWu99 / llm_kvcache_sparsity
  Implement some method of LLM KV Cache Sparsity
  ☆30Updated 9 months ago
• tsinghua-ideal / Canvas
  Canvas: End-to-End Kernel Architecture Search in Neural Networks
  ☆26Updated 3 months ago
• d-matrix-ai / keyformer-llm
  ☆52Updated 11 months ago
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆108Updated last year
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆63Updated this week
• UMass-LIDS / Proteus
  Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling
  ☆10Updated last year
• Thesys-lab / Helix-ASPLOS25
  Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"
  ☆25Updated 3 months ago
• shishishu / LLM-Inference-Acceleration
  LLM Inference with Deep Learning Accelerator.
  ☆31Updated last month
• l1nkr / DL-Compiler-Navigation
  Machine Learning Compiler Road Map
  ☆43Updated last year
• gudiandian / ElasticFlow
  ☆16Updated 10 months ago
• zhuangwang93 / Cupcake
  Cupcake: A Compression Scheduler for Scalable Communication-Efficient Distributed Training (MLSys '23)
  ☆9Updated last year
• JF-D / Proteus
  ☆20Updated 8 months ago
• Mutinifni / splitwise-sim
  LLM serving cluster simulator
  ☆93Updated 10 months ago