Alternatives and similar repositories for neuroshard

Users that are interested in neuroshard are comparing it to the libraries listed below

• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆203Updated last year
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆93Updated 2 years ago
• hao-ai-lab / MuxServe
  ☆80Updated 2 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆96Updated last year
• amazon-science / FeatGraph
  ☆70Updated 4 years ago
• xiezhq-hermann / graphiler
  Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…
  ☆59Updated 3 years ago
• daochenzha / autoshard
  [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems
  ☆22Updated 2 years ago
• DataStates / datastates-llm
  LLM checkpointing for DeepSpeed/Megatron
  ☆22Updated 3 weeks ago
• facebookresearch / dlrm_datasets
  Set of datasets for the deep learning recommendation model (DLRM).
  ☆48Updated 3 years ago
• PeterSH6 / MSPipe
  ☆15Updated last year
• jasperzhong / GNNFlow
  Distributed Deep Graph Learning Framework for Dynamic Graphs
  ☆18Updated last year
• GATECH-EIC / PipeGCN
  [ICLR 2022] "PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication" by Cheng Wan, Y…
  ☆33Updated 2 years ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 10 months ago
• chenzhao / light-dist-gnn
  ☆47Updated 3 years ago
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆31Updated last year
• henryzhongsc / longctx_bench
  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…
  ☆87Updated 9 months ago
• graphcore-research / llm-inference-research
  An experimentation platform for LLM inference optimisation
  ☆35Updated last year
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆49Updated 4 months ago
• tyler-griggs / melange-release
  ☆48Updated last year
• YukeWang96 / MGG_OSDI23
  Artifact for OSDI'23: MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Mult…
  ☆41Updated last year
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆135Updated last year
• tonyzhang617 / nomad-dist
  ☆39Updated last year
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆253Updated last year
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆66Updated last year
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆122Updated 2 years ago
• marius-team / marius
  Large scale graph learning on a single machine.
  ☆166Updated 10 months ago
• Relaxed-System-Lab / HexGen
  [ICML 2024] Serving LLMs on heterogeneous decentralized clusters.
  ☆33Updated last year
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆20Updated 2 years ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …
  ☆35Updated 3 months ago
• K-Wu / pytorch-direct_dgl
  Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture (accepted by PVLDB)
  ☆44Updated 2 years ago