Alternatives and similar repositories for fastsafetensors

Users that are interested in fastsafetensors are comparing it to the libraries listed below

• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆406Updated 4 months ago
• simon-mo / vLLM-Benchmark
  ☆31Updated 9 months ago
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆237Updated last week
• tyler-griggs / melange-release
  ☆48Updated last year
• run-ai / runai-model-streamer
  ☆278Updated last week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆286Updated 5 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆60Updated 11 months ago
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆111Updated this week
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆260Updated this week
• Dao-AILab / sonic-moe
  Accelerating MoE with IO and Tile-aware Optimizations
  ☆563Updated 2 weeks ago
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆323Updated last week
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆73Updated 8 months ago
• neuralmagic / AutoFP8
  ☆206Updated 8 months ago
• NVIDIA / nvshmem
  NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process com…
  ☆461Updated last month
• abcdabcd987 / libfabric-efa-demo
  ☆76Updated last year
• CentML / lorafusion
  LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
  ☆23Updated 4 months ago
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆554Updated 2 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆389Updated 2 months ago
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆255Updated this week
• stepfun-ai / StepMesh
  ☆342Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆93Updated 10 months ago
• inclusionAI / asystem-amem
  A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.
  ☆87Updated last month
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆657Updated 4 months ago
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆384Updated this week
• perplexityai / libfabric-efa-demo
  ☆71Updated 11 months ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆864Updated this week
• imbue-ai / cluster-health
  ☆321Updated last year
• vllm-project / router
  A high-performance and light-weight router for vLLM large scale deployment
  ☆95Updated last week
• NVIDIA / tilus
  Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.
  ☆440Updated last month
• OpenSQZ / MegatronApp
  Toolchain built around the Megatron-LM for Distributed Training
  ☆84Updated last month