htop for your LLM inference cluster
☆21May 11, 2026Updated 3 months ago
Alternatives and similar repositories for llmtop
Users that are interested in llmtop are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Concurrent bulk transfer of keys from one redis server to another. Written in Go / GoLang.☆13Mar 20, 2021Updated 5 years ago
- Tiny Container Engine☆11Jan 16, 2023Updated 3 years ago
- Deploy the SC2 system on Kubernetes.☆12May 7, 2025Updated last year
- Source code of our paper "Focus on the Target’s Vocabulary: Masked Label Smoothing for Machine Translation" @ ACL 2022☆13Apr 13, 2022Updated 4 years ago
- On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation (Findings of EMNLP 2021))☆13Nov 21, 2021Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Repository used for the master thesis "A Benchmark Suite for Serverless Computing".☆10Dec 10, 2022Updated 3 years ago
- A layered experiment framework for C++/java/go☆14Nov 13, 2019Updated 6 years ago
- Official Implementation for the ICLR2023 paper "Fuzzy Alignments in Directed Acyclic Graph for Non-autoregressive Machine Translation"☆14Mar 1, 2023Updated 3 years ago
- Code and dataset for Polyglot Prompting: Multilingual Multitask Prompt Training.☆18Dec 7, 2022Updated 3 years ago
- ☆13Updated this week
- Enhancing the convergence speed by 2x and improving the training success of Physics-Informed Neural Networks (PINNs).☆13Oct 14, 2024Updated last year
- ☆12Jun 30, 2025Updated last year
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆12Oct 10, 2020Updated 5 years ago
- A minimal bootstrap scheme for fast boot of serverless microVMs with AMD Secure Encrypted Virtualization (SEV)☆15Feb 7, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆14Apr 22, 2024Updated 2 years ago
- ☆12Jun 30, 2024Updated 2 years ago
- ☆14Sep 10, 2021Updated 4 years ago
- Sysbox-fs repository☆20Updated this week
- Code for "Improving Translation Faithfulness of Large Language Models via Augmenting Instructions"☆12Aug 26, 2023Updated 3 years ago
- ☆17Mar 2, 2026Updated 5 months ago
- ☆23Mar 16, 2026Updated 5 months ago
- ☆14Oct 6, 2025Updated 10 months ago
- Evaluation code for confidential virtual machines (AMD SEV-SNP / Intel TDX)☆17Mar 12, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Intel® SHMEM - Device initiated shared memory based communication library☆33Aug 5, 2026Updated 3 weeks ago
- A tool to post-process json trace files for IBM-AIU performance analysis. It enhances the traces with additional statistics extracted fro…☆13Updated this week
- A repo for code based language models☆18Feb 10, 2021Updated 5 years ago
- This is a collection of sidecar containers that can be incorporated within confidential container groups on Azure Container Instances.☆20Jul 27, 2023Updated 3 years ago
- Source code for "Importance-based Neuron Allocation for Multilingual Neural Machine Translation"☆12Sep 15, 2021Updated 4 years ago
- A kernel module to obtain source IPv4 address in the TCP option section.☆27Mar 22, 2022Updated 4 years ago
- CS168 Project 1: Routing☆13Feb 17, 2020Updated 6 years ago
- Code and Data release for "Improving Multilingual Translation by Representation and Gradient Regularization" (Yang et al. EMNLP 2021), an…☆13Aug 12, 2024Updated 2 years ago
- EPOCH Input System Version 2☆10Jun 5, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This repository contains the results and code for the MLPerf™ Training v2.0 benchmark.☆29Feb 23, 2024Updated 2 years ago
- Digital Ocean docker clustering demo with terraform☆12Dec 6, 2016Updated 9 years ago
- Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding☆20Nov 16, 2022Updated 3 years ago
- gpu-provisioner is a Karpenter Azure provider implementation. This project is used in Kaito to create a machine which is an Azure nodepoo…☆24Aug 21, 2026Updated last week
- Automatically harvested multilingual contrastive word sense disambiguation test sets for machine translation☆18Jan 18, 2021Updated 5 years ago
- ☆13Jul 26, 2021Updated 5 years ago
- Correct the container's CGroup-view☆16Jan 7, 2023Updated 3 years ago