argonne-lcf / LLM-Inference-Bench

Related projects ⓘ

Alternatives and complementary repositories for LLM-Inference-Bench

• brightlaboratory / polydl
  ☆11Updated 3 years ago
• graphcore-research / unit-scaling-demo
  Unit Scaling demo and experimentation code
  ☆16Updated 8 months ago
• xuqifan897 / Optimus
  ☆26Updated 3 years ago
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆20Updated 6 months ago
• illinois-impact / klap
  A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches
  ☆14Updated 5 years ago
• zhisbug / Cavs
  Cavs: An Efficient Runtime System for Dynamic Neural Networks
  ☆13Updated 4 years ago
• microsoft / dist-ir
  An IR for efficiently simulating distributed ML computation.
  ☆25Updated 10 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆61Updated last month
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆11Updated 3 months ago
• abacusai / gh200-llm
  Packages and instructions for training and inference of LLMs on NVIDIA's new GH200 machines
  ☆19Updated 2 months ago
• Emma926 / mcbench
  Mille Crepe Bench: layer-wise performance analysis for deep learning frameworks.
  ☆17Updated 5 years ago
• exists-forall / striped_attention
  ☆36Updated last year
• hao-ai-lab / MuxServe
  ☆46Updated 5 months ago
• ucamrl / xrlflow
  ☆13Updated last year
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• spcl / sten
  Sparsity support for PyTorch
  ☆31Updated this week
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆98Updated last week
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year
• nod-ai / techtalks
  ☆16Updated 7 months ago
• NVIDIA / HMM_sample_code
  CUDA 12.2 HMM demos
  ☆17Updated 3 months ago
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆28Updated 5 months ago
• tyler-griggs / melange-release
  ☆38Updated 4 months ago
• TiledTensor / TiledKernel
  TiledKernel is a code generation library based on macro kernels and memory hierarchy graph data structure.
  ☆19Updated 6 months ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆34Updated 2 years ago
• thu-pacman / FasterMoE
  ☆70Updated 2 years ago
• alexzhang13 / Triton-Puzzles-Solutions
  Personal solutions to the Triton Puzzles
  ☆16Updated 4 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆72Updated last month
• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆44Updated 5 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• tonyzhang617 / nomad-dist
  ☆19Updated 8 months ago