Module, Model, and Tensor Serialization/Deserialization
☆328Jul 7, 2026Updated 3 months ago
Alternatives and similar repositories for tensorizer
Users that are interested in tensorizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆53Updated this week
- ☆401Updated this week
- Getting Started with the CoreWeave Kubernetes GPU Cloud☆83Jun 13, 2025Updated last year
- NVIDIA NCCL Tests for Distributed Training☆162Updated this week
- High-performance safetensors model loader☆181Oct 17, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- NVIDIA Inference Xfer Library (NIXL)☆1,345Updated this week
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆197Updated this week
- CUDA checkpoint and restore utility☆505Jul 6, 2026Updated 3 months ago
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated 7 months ago
- A sample pattern for running CI tests on Modal☆21Apr 12, 2025Updated last year
- LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving☆897Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,413Updated this week
- Serving multiple LoRA finetuned LLM as one☆1,177May 8, 2024Updated 2 years ago
- The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build cu…☆10,773Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆498Updated this week
- Folding @ Home with NVIDIA GPU support☆19Mar 20, 2020Updated 6 years ago
- NVIDIA Network Operator☆378Updated this week
- clustering algorithm implementation☆13Oct 19, 2026Updated last week
- FlashInfer: Kernel Library for LLM Serving☆6,821Updated this week
- PyTorch Single Controller☆1,084Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,624Updated this week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆428Oct 20, 2026Updated last week
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆522Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Run Slurm in Kubernetes☆456Updated this week
- A simple and modular imageboard scraper written in python☆15Sep 7, 2026Updated last month
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆407May 31, 2026Updated 5 months ago
- Pragmatic approach to parsing import profiles for CI's☆12Jul 1, 2024Updated 2 years ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆540Updated this week
- A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine☆902Oct 21, 2026Updated last week
- Kubectl plugin for setting conditions on nodes☆16Sep 21, 2026Updated last month
- MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.☆2,116Jun 30, 2025Updated last year
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆551Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Gateway API Inference Extension☆799Oct 19, 2026Updated last week
- The backend behind the LLM-Perf Leaderboard☆11May 5, 2024Updated 2 years ago
- LLMPerf is a library for validating and benchmarking LLMs☆1,127Dec 9, 2024Updated last year
- Home for OctoML PyTorch Profiler☆112Apr 24, 2023Updated 3 years ago
- PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP☆164Sep 12, 2025Updated last year
- PyTorch native quantization for training and inference☆3,018Updated this week
- State of the art inference performance with modern accelerators on Kubernetes☆5,108Updated this week