coreweave / tensorizerLinks
Module, Model, and Tensor Serialization/Deserialization
☆268Updated last month
Alternatives and similar repositories for tensorizer
Users that are interested in tensorizer are comparing it to the libraries listed below
Sorting:
- ☆254Updated 2 weeks ago
- CUDA checkpoint and restore utility☆371Updated 2 weeks ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆410Updated this week
- ☆314Updated last year
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆380Updated 3 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆391Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated 11 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆223Updated last week
- A library to analyze PyTorch traces.☆414Updated last week
- High-performance safetensors model loader☆62Updated 2 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆132Updated last week
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆436Updated this week
- OpenAI compatible API for TensorRT LLM triton backend☆215Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆213Updated this week
- NVIDIA NCCL Tests for Distributed Training☆111Updated last week
- Benchmark suite for LLMs from Fireworks.ai☆83Updated this week
- OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)☆279Updated this week
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆315Updated last week
- ☆298Updated this week
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated last week
- The Triton backend for the ONNX Runtime.☆162Updated this week
- Home for OctoML PyTorch Profiler☆114Updated 2 years ago
- ☆146Updated last week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆268Updated 2 months ago
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆73Updated 2 weeks ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- A safetensors extension to efficiently store sparse quantized tensors on disk☆164Updated this week
- Inference server benchmarking tool☆112Updated 5 months ago
- The Triton backend for the PyTorch TorchScript models.☆159Updated last week
- Google TPU optimizations for transformers models☆120Updated 8 months ago