Alternatives and similar repositories for tokenweave

Users that are interested in tokenweave are comparing it to the libraries listed below

• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆21Updated 5 months ago
• merrymercy / Awesome-Efficient-LLM
  A curated list for Efficient Large Language Models
  ☆11Updated last year
• microsoft / FractalTensor
  FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …
  ☆26Updated 6 months ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆20Updated last year
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆27Updated 4 months ago
• chhzh123 / ptc-tutorial
  PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo
  ☆18Updated 2 years ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• tile-ai / TileAttention
  ☆39Updated this week
• cassiewilliam / cuda_op_benchmark
  方便扩展的Cuda算子理解和优化框架，仅用在学习使用
  ☆15Updated last year
• eth-easl / mixtera
  A lightweight, user-friendly data-plane for LLM training.
  ☆19Updated 2 months ago
• argonne-lcf / LLM-Inference-Bench
  LLM-Inference-Bench
  ☆45Updated 2 weeks ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 6 months ago
• DataStates / datastates-llm
  LLM checkpointing for DeepSpeed/Megatron
  ☆17Updated this week
• illinois-impact / klap
  A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches
  ☆15Updated 6 years ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆79Updated 7 months ago
• eth-easl / deltazip
  Compression for Foundation Models
  ☆32Updated 3 months ago
• LeiWang1999 / Stream-k.tvm
  ☆19Updated 8 months ago
• microsoft / AttentionEngine
  ☆71Updated last month
• casys-kaist / EnvPipe
  ☆25Updated last year
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆13Updated 11 months ago
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 4 years ago
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆41Updated last month
• pkusys / Auncel
  Vector search with bounded performance.
  ☆35Updated last year
• CGCL-codes / streambox
  ☆12Updated last year
• abcdabcd987 / libfabric-efa-demo
  ☆39Updated 5 months ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆64Updated 7 months ago
• hao-ai-lab / MuxServe
  ☆62Updated last year
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆25Updated 7 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• HPMLL / NVIDIA-Hopper-Benchmark
  ☆44Updated 3 weeks ago