Alternatives and similar repositories for modyn

Users that are interested in modyn are comparing it to the libraries listed below

• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆59Updated 2 years ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• eth-easl / cachew
  ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).
  ☆38Updated 9 months ago
• feature-store / ralf
  ☆30Updated 2 years ago
• kungfu-team / tenplex
  Dynamic resources changes for multi-dimensional parallelism training
  ☆25Updated 7 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆73Updated 3 months ago
• stanford-mast / cedar
  ☆12Updated 8 months ago
• uclasystem / bamboo
  Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.
  ☆50Updated 2 years ago
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆81Updated last year
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆78Updated 4 months ago
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 7 months ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆123Updated last year
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆28Updated last year
• SymbioticLab / ModelKeeper
  A Cluster-Wide Model Manager to Accelerate DNN Training via Automated Training Warmup
  ☆35Updated 2 years ago
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆56Updated 3 years ago
• HPMLL / BurstGPT
  A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems
  ☆177Updated 8 months ago
• hao-ai-lab / MuxServe
  ☆62Updated last year
• YuhanLiu11 / AutoFreeze
  ☆22Updated 4 years ago
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆88Updated last year
• msr-fiddle / DS-Analyzer
  ☆37Updated 4 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆32Updated 3 years ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆39Updated 2 years ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆163Updated 9 months ago
• msr-fiddle / CheckFreq
  ☆53Updated 4 years ago
• vqpy / vqpy
  VQPy: An object-oriented approach to modern video analytics
  ☆42Updated 7 months ago
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆36Updated 3 years ago
• tyler-griggs / melange-release
  ☆47Updated last year
• ScalingIntelligence / hydragen
  Hydragen: High-Throughput LLM Inference with Shared Prefixes
  ☆41Updated last year
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆157Updated this week
• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆16Updated last year