XuehaiPan / nvitopLinks
An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
ā6,380Updated last week
Alternatives and similar repositories for nvitop
Users that are interested in nvitop are comparing it to the libraries listed below
Sorting:
- š A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iā¦ā9,377Updated this week
- GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcommā9,853Updated last month
- Fast and memory-efficient exact attentionā21,067Updated this week
- š A simple command-line utility for querying and monitoring GPU statusā4,308Updated 8 months ago
- Development repository for the Triton language and compilerā17,861Updated this week
- Multi-GPU CUDA stress testā2,037Updated last month
- Simple, safe way to store and distribute tensorsā3,547Updated this week
- Hackable and optimized Transformers building blocks, supporting a composable construction.ā10,184Updated this week
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"ā13,062Updated last year
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)ā9,312Updated 3 weeks ago
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.ā2,922Updated 5 months ago
- Accessible large language models via k-bit quantization for PyTorch.ā7,815Updated this week
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)ā¦ā14,220Updated this week
- Transformer related optimization, including BERT, GPTā6,365Updated last year
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.ā7,377Updated this week
- View model summaries in PyTorch!ā2,885Updated last week
- PyTorch extensions for high performance and large scale training.ā3,388Updated 7 months ago
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.ā6,165Updated 3 months ago
- š¤ PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.ā20,268Updated last week
- Train transformer language models with reinforcement learning.ā16,638Updated this week
- SGLang is a fast serving framework for large language models and vision language models.ā21,569Updated this week
- LAVIS - A One-stop Library for Language-Vision Intelligenceā11,065Updated last year
- ā4,109Updated last year
- Running large language models on a single GPU for throughput-oriented scenarios.ā9,380Updated last year
- PyTorch native post-training libraryā5,615Updated last week
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (Nā¦ā4,697Updated last month
- Build and share delightful machine learning apps, all in Python. š Star to support our work!ā40,937Updated this week
- Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.ā4,237Updated last month
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.ā24,159Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMsā65,334Updated this week