Alternatives and similar repositories for modyn

Users that are interested in modyn are comparing it to the libraries listed below

• eth-easl / cachew
  ML Input Data Processing as a Service. This repository contains the source code for Cachew (built on top of TensorFlow).
  ☆39Updated last year
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 8 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆96Updated last year
• vqpy / vqpy
  VQPy: An object-oriented approach to modern video analytics
  ☆42Updated last year
• WukLab / preble
  Stateful LLM Serving
  ☆87Updated 7 months ago
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆161Updated last month
• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆60Updated 2 years ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆188Updated last year
• stanford-mast / INFaaS
  Model-less Inference Serving
  ☆92Updated last year
• ml-energy / zeus
  Measure and optimize the energy consumption of your AI applications!
  ☆306Updated this week
• tyler-griggs / melange-release
  ☆47Updated last year
• msr-fiddle / DS-Analyzer
  ☆38Updated 4 years ago
• alpa-projects / mms
  AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)
  ☆88Updated 2 years ago
• feature-store / ralf
  ☆31Updated 3 years ago
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆130Updated last year
• hao-ai-lab / MuxServe
  ☆74Updated 2 weeks ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆41Updated 2 years ago
• alibaba / ServeGen
  A framework for generating realistic LLM serving workloads
  ☆73Updated 3 weeks ago
• kvcache-ai / TrEnv-X
  ☆63Updated last month
• uclasystem / bamboo
  Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.
  ☆53Updated 2 years ago
• S-Lab-System-Group / Hydro
  Surrogate-based Hyperparameter Tuning System
  ☆27Updated 2 years ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆419Updated 2 weeks ago
• GuanhuaWang / sensAI
  sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data
  ☆65Updated last year
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆54Updated last year
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated 11 months ago
• abcdabcd987 / libfabric-efa-demo
  ☆65Updated 9 months ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆120Updated 11 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆62Updated last year
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆92Updated 2 years ago
• geoffxy / habitat
  🔮 Execution time predictions for deep neural network training iterations across different GPUs.
  ☆62Updated 2 years ago