Alternatives and similar repositories for neuroshard

Users that are interested in neuroshard are comparing it to the libraries listed below

• daochenzha / autoshard
  [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems
  ☆22Updated 2 years ago
• daochenzha / dreamshard
  [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems
  ☆29Updated 2 years ago
• Ying1123 / llm-caching-multiplexing
  ☆20Updated 2 years ago
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆29Updated 6 months ago
• amazon-science / FeatGraph
  ☆70Updated 3 years ago
• eth-easl / mixtera
  A lightweight, user-friendly data-plane for LLM training.
  ☆16Updated last month
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆39Updated last month
• zirui-ray-liu / Exact
  ☆21Updated 3 years ago
• xiezhq-hermann / graphiler
  Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…
  ☆61Updated 2 years ago
• eth-easl / deltazip
  Compression for Foundation Models
  ☆31Updated 2 months ago
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆21Updated 4 months ago
• IllinoisGraphBenchmark / IGB-Datasets
  Largest realworld open-source graph dataset - Worked done under IBM-Illinois Discovery Accelerator Institute and Amazon Research Awards a…
  ☆82Updated 5 months ago
• Infini-AI-Lab / APE
  ☆26Updated 3 months ago
• K-Wu / pytorch-direct_dgl
  PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…
  ☆44Updated last year
• 66RING / CritiPrefill
  Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".
  ☆14Updated 8 months ago
• facebookresearch / dlrm_datasets
  Set of datasets for the deep learning recommendation model (DLRM).
  ☆47Updated 2 years ago
• tonyzhao-jt / LLM-PQ
  Official Repo for "LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization"
  ☆32Updated last year
• amazon-science / piperag
  PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)
  ☆21Updated 11 months ago
• jasperzhong / GNNFlow
  Distributed Deep Graph Learning Framework for Dynamic Graphs
  ☆13Updated last year
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆86Updated 2 years ago
• ucamrl / xrlflow
  ☆15Updated 2 years ago
• jjiantong / FastPGM
  Fast Parallel Probabilistic Graphical Model Learning and Inference [IPDPS'22, PPoPP'23, USENIX ATC'24]
  ☆44Updated 4 months ago
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆14Updated 2 years ago
• uw-mad-dash / decoding-speculative-decoding
  ☆12Updated 9 months ago
• timlee0212 / SiDA-MoE
  Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"
  ☆18Updated last year
• DS3Lab / Decentralized_FM_alpha
  ☆19Updated 2 years ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆39Updated last year
• STAR-Laboratory / Accelerating-RecSys-Training
  Accelerating Recommender model training by leveraging popular choices -- VLDB 2022
  ☆30Updated 8 months ago
• Raincleared-Song / sparse_gpu_operator
  GPU operators for sparse tensor operations
  ☆32Updated last year
• henryzhongsc / longctx_bench
  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…
  ☆78Updated 3 months ago