Alternatives and similar repositories for fastsafetensors

Users that are interested in fastsafetensors are comparing it to the libraries listed below

• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆169Updated this week
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆352Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆87Updated 2 months ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆339Updated 4 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆39Updated 3 months ago
• simon-mo / vLLM-Benchmark
  ☆26Updated last month
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆69Updated 3 weeks ago
• pytorch-labs / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆150Updated this week
• triton-inference-server / triton_distributed
  ☆49Updated 2 months ago
• bytedance-iaas / splitwise-demos
  ☆25Updated 2 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆232Updated last week
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆71Updated 3 weeks ago
• abcdabcd987 / libfabric-efa-demo
  ☆35Updated 4 months ago
• yifuwang / symm-mem-recipes
  ☆83Updated 5 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆75Updated 8 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆109Updated 10 months ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆127Updated this week
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆131Updated 3 weeks ago
• run-ai / runai-model-streamer
  ☆214Updated this week
• triton-lang / kernels
  ☆79Updated 6 months ago
• ppl-ai / pplx-kernels
  Perplexity GPU Kernels
  ☆318Updated last week
• InternLM / turbomind
  ☆85Updated 2 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆116Updated this week
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆250Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆270Updated this week
• ppl-ai / libfabric-efa-demo
  ☆61Updated 3 months ago
• tyler-griggs / melange-release
  ☆46Updated 11 months ago
• neuralmagic / AutoFP8
  ☆193Updated 3 weeks ago
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆45Updated last week
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆395Updated 3 weeks ago