Nano vLLM v1 engine
☆15Aug 6, 2025Updated last year
Alternatives and similar repositories for nano-vllm-v1
Users that are interested in nano-vllm-v1 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17May 10, 2024Updated 2 years ago
- Vitis 部署加速器工作流介绍☆13Jan 10, 2025Updated last year
- 龙芯杯2021个人赛决赛最终代码☆11Sep 1, 2021Updated 5 years ago
- CopyNet (Copy Mechanism in Seq2Seq) implementation with TensorFlow 2☆10Nov 21, 2022Updated 3 years ago
- PilotFish harvests the free GPU cycles of cloud gaming with deep learning training☆14Jul 2, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.☆322Sep 9, 2026Updated last week
- Nano SGLang☆16Jul 21, 2025Updated last year
- This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibrat…☆23May 21, 2025Updated last year
- LightRFT (Light Reinforcement Fine-Tuning) is an advanced reinforcement learning fine-tuning framework designed for Large Language Models…☆19Jan 12, 2026Updated 8 months ago
- Dynamic Spear Model☆12Jul 24, 2019Updated 7 years ago
- Running LLaMA 3 with Rust.☆10May 21, 2024Updated 2 years ago
- Enhanced version of original AutoGPTQ (https://github.com/PanQiWei/AutoGPTQ).☆10Nov 2, 2023Updated 2 years ago
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- Code for the paper "A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis"☆20Jun 12, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A curated list of papers, tools, and benchmarks on LLM-based computer-use agents, covering both terminal/CLI and GUI approaches.☆18Aug 17, 2026Updated last month
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆23Mar 15, 2024Updated 2 years ago
- Code Scorer using LLM☆12Jun 22, 2026Updated 2 months ago
- A Rust-based, SenseVoiceSmall☆40Updated this week
- The Bytepiece Tokenizer Implemented in Rust.☆15Nov 28, 2023Updated 2 years ago
- ☆19May 16, 2024Updated 2 years ago
- Embedding-based evaluation metrics for dialogue generation.☆15Jan 8, 2023Updated 3 years ago
- A Feishu/Lark AI agent bot☆16Feb 27, 2026Updated 6 months ago
- ☆24Mar 7, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆20Oct 5, 2025Updated 11 months ago
- An efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences☆33Mar 7, 2024Updated 2 years ago
- Agile Notifier - an easy way of monitoring Agile SW Engineering, including CI (Continuous Integration), SCM (Source Control Management), …☆18Feb 28, 2016Updated 10 years ago
- [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators☆27Jul 26, 2023Updated 3 years ago
- Official code for "Breaking the Ceiling in On-Policy Distillation via Multi-Agent Debate" (arXiv:2605.01347).☆37Jul 31, 2026Updated last month
- An attempt to migrate Karpathy's llm.c to safe rust.☆13Jun 4, 2024Updated 2 years ago
- official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"☆25Oct 11, 2025Updated 11 months ago
- A high-performance C/C++ inference server for Qwen3-ASR , optimized for CPU/GPU real-time streaming speech recognition.☆17Jun 27, 2026Updated 2 months ago
- ☆30Sep 26, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Zero-shot evaluation on LEXGLUE tasks with GTP3.5☆29Mar 11, 2023Updated 3 years ago
- Keep a journal of things I want to share☆12Aug 23, 2022Updated 4 years ago
- Rust standalone inference of Namo-500M series models. Extremly tiny, runing VLM on CPU.☆24Mar 12, 2025Updated last year
- Candle Pipelines provides a simple, intuitive interface for Rust developers who want to work with Large Language Models locally, powered …☆23Jan 5, 2026Updated 8 months ago
- InSales e-commerce platform API bindings☆14Jul 13, 2024Updated 2 years ago
- Streaming Text to Speech Web UI☆22May 6, 2024Updated 2 years ago
- EMNLP 2019: Dually Interactive Matching Network for Personalized Response Selection in Retrieval-Based Chatbots☆20Feb 7, 2020Updated 6 years ago