Alternatives and similar repositories for fastsafetensors

Users that are interested in fastsafetensors are comparing it to the libraries listed below

• ai-dynamo / aiconfigurator
  Offline optimization of your disaggregated Dynamo graph
  ☆57Updated this week
• simon-mo / vLLM-Benchmark
  ☆31Updated 4 months ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆366Updated 7 months ago
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆205Updated last week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆263Updated 3 weeks ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆156Updated last week
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆49Updated 7 months ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆70Updated 4 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆326Updated 3 months ago
• tyler-griggs / melange-release
  ☆47Updated last year
• run-ai / runai-model-streamer
  ☆239Updated last week
• cchan / tccl
  extensible collectives library in triton
  ☆88Updated 5 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆74Updated 5 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆79Updated 6 months ago
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆93Updated this week
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆603Updated this week
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆120Updated 9 months ago
• NVIDIA / nvshmem
  NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…
  ☆268Updated this week
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆82Updated last year
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆486Updated 3 months ago
• neuralmagic / AutoFP8
  ☆197Updated 4 months ago
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆458Updated last month
• anyscale / llm-continuous-batching-benchmarks
  ☆121Updated last year
• stepfun-ai / StepMesh
  ☆290Updated last week
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆124Updated 9 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆165Updated this week
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆217Updated last week
• abcdabcd987 / libfabric-efa-demo
  ☆57Updated 8 months ago
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆36Updated 2 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated 7 months ago