Nano vLLM v1 engine
☆16Aug 6, 2025Updated last year
Alternatives and similar repositories for nano-vllm-v1
Users that are interested in nano-vllm-v1 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code and data repository for two papers (ACL & EMNLP 2024) on the topic of collapse in model editing.☆10Dec 20, 2024Updated last year
- ☆17May 10, 2024Updated 2 years ago
- Vitis 部署加速器工作流介绍☆13Jan 10, 2025Updated last year
- Provides a minimal implementation to extract FLAN datasets for further processing☆11Feb 1, 2023Updated 3 years ago
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆300Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Nano SGLang☆16Jul 21, 2025Updated last year
- This code implements a basic, Twitter-aware tokenizer.☆12Feb 8, 2024Updated 2 years ago
- 🚀 轻量视频🎥 大模型🤖☆23Apr 27, 2025Updated last year
- ViTALiTy (HPCA'23) Code Repository☆23Mar 13, 2023Updated 3 years ago
- This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibrat…☆23May 21, 2025Updated last year
- Code for paper "Spider: Any-to-Many Multimodal LLM"☆16Apr 26, 2025Updated last year
- LightRFT (Light Reinforcement Fine-Tuning) is an advanced reinforcement learning fine-tuning framework designed for Large Language Models…☆19Jan 12, 2026Updated 6 months ago
- Running LLaMA 3 with Rust.☆10May 21, 2024Updated 2 years ago
- Enhanced version of original AutoGPTQ (https://github.com/PanQiWei/AutoGPTQ).☆10Nov 2, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A curated list of papers, tools, and benchmarks on LLM-based computer-use agents, covering both terminal/CLI and GUI approaches.☆16Jul 28, 2026Updated last week
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆23Mar 15, 2024Updated 2 years ago
- Code Scorer using LLM☆12Jun 22, 2026Updated last month
- A Rust-based, SenseVoiceSmall☆39Apr 27, 2026Updated 3 months ago
- The Bytepiece Tokenizer Implemented in Rust.☆15Nov 28, 2023Updated 2 years ago
- Embedding-based evaluation metrics for dialogue generation.☆15Jan 8, 2023Updated 3 years ago
- Utility to open a docx document, update indexes and save as pdf.☆13Oct 30, 2018Updated 7 years ago
- ☆24Mar 7, 2025Updated last year
- ☆20Oct 5, 2025Updated 10 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆32Mar 7, 2024Updated 2 years ago
- Agile Notifier - an easy way of monitoring Agile SW Engineering, including CI (Continuous Integration), SCM (Source Control Management), …☆18Feb 28, 2016Updated 10 years ago
- [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators☆26Jul 26, 2023Updated 3 years ago
- 重庆大学计算机学院计算机科学与技术课程相关文档和实验☆23Mar 3, 2023Updated 3 years ago
- ☆15Aug 4, 2021Updated 5 years ago
- A 5-level pipelined MIPS CPU with branch prediction and great cache.☆19May 9, 2021Updated 5 years ago
- official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"☆25Oct 11, 2025Updated 9 months ago
- ☆30Sep 26, 2025Updated 10 months ago
- ICLR 2026 Accepted Papers Simple Analysis☆28Feb 2, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Neural Network implementation in Numpy and Keras. Batch Normalization, Dropout, L2 Regularization and Optimizers☆16May 21, 2019Updated 7 years ago
- Keep a journal of things I want to share☆12Aug 23, 2022Updated 3 years ago
- vibe cli 模版☆17Jul 2, 2025Updated last year
- Cloud-Act2 是一种对分散于不同机房之间的服务进行管理，对远程服务器进行命令调用和文件下发的服务工具。☆15Mar 5, 2019Updated 7 years ago
- Candle Pipelines provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered …☆23Jan 5, 2026Updated 7 months ago
- InSales e-commerce platform API bindings☆14Jul 13, 2024Updated 2 years ago
- Streaming Text to Speech Web UI☆22May 6, 2024Updated 2 years ago