Alternatives and similar repositories for neuroshard:

Users that are interested in neuroshard are comparing it to the libraries listed below

• daochenzha / autoshard
  [KDD 2022] AutoShard: Automated Embedding Table Sharding for Recommender Systems
  ☆21Updated 2 years ago
• daochenzha / dreamshard
  [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems
  ☆29Updated 2 years ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆31Updated 3 weeks ago
• xiezhq-hermann / graphiler
  Graphiler is a compiler stack built on top of DGL and TorchScript which compiles GNNs defined using user-defined functions (UDFs) into ef…
  ☆61Updated 2 years ago
• amazon-science / disttgl
  ☆13Updated last year
• zirui-ray-liu / Exact
  ☆19Updated 3 years ago
• Ying1123 / llm-caching-multiplexing
  ☆20Updated last year
• K-Wu / pytorch-direct_dgl
  PyTorch-Direct code on top of PyTorch-1.8.0nightly (e152ca5) for Large Graph Convolutional Network Training with GPU-Oriented Data Commun…
  ☆45Updated last year
• DS3Lab / Decentralized_FM_alpha
  ☆18Updated last year
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆28Updated 4 months ago
• amazon-science / FeatGraph
  ☆73Updated 3 years ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆73Updated last month
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆90Updated 11 months ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆13Updated 8 months ago
• tyler-griggs / melange-release
  ☆45Updated 9 months ago
• MITIBMxGraph / SALIENT
  The official SALIENT system described in the paper "Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and P…
  ☆38Updated last year
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆42Updated 4 months ago
• hao-ai-lab / MuxServe
  ☆55Updated 9 months ago
• IllinoisGraphBenchmark / IGB-Datasets
  Largest realworld open-source graph dataset - Worked done under IBM-Illinois Discovery Accelerator Institute and Amazon Research Awards a…
  ☆79Updated 3 months ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆44Updated 2 years ago
• zhengzangw / Sequence-Scheduling
  PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
  ☆85Updated last year
• Raincleared-Song / sparse_gpu_operator
  GPU operators for sparse tensor operations
  ☆31Updated last year
• jasperzhong / GNNFlow
  Distributed Deep Graph Learning Framework for Dynamic Graphs
  ☆12Updated last year
• henryzhongsc / longctx_bench
  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…
  ☆67Updated last month
• STAR-Laboratory / Accelerating-RecSys-Training
  Accelerating Recommender model training by leveraging popular choices -- VLDB 2022
  ☆30Updated 6 months ago
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆89Updated 4 months ago
• lfsszd / CS-Drafting
  Cascade Speculative Drafting
  ☆29Updated 11 months ago
• facebookresearch / dlrm_datasets
  Set of datasets for the deep learning recommendation model (DLRM).
  ☆42Updated 2 years ago
• DataStates / datastates-llm
  LLM checkpointing for DeepSpeed/Megatron
  ☆16Updated last week