A specialized optimization of nano-vllm for prefill-only inference tasks, designed for industrial-scale discriminative applications with multimodal large language models
☆120Sep 20, 2026Updated last month
Alternatives and similar repositories for nano-vllm-prefillonly
Users that are interested in nano-vllm-prefillonly are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A series-symbol (S2) dual-modality data generation mechanism, enabling the unrestricted creation of high-quality time series data paired …☆149Sep 17, 2026Updated last month
- The code and model weights for AdaQSPR.☆23Dec 11, 2025Updated 10 months ago
- Agent skills for Claude Code and Codex: self-reflection, content, slides, WeChat formatting. Copy a folder, done. 加宁的 Skill 合集，能读 SKILL.m…☆329Updated this week
- Lightweight, provider-agnostic long-term memory for conversational agents☆21Jul 27, 2026Updated 2 months ago
- Animated macOS desktop pet and AI coding agent monitor for Claude Code, Codex, Cursor, and Pi, with local and remote SSH session tracking…☆27Oct 5, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Detect, gate, redact, and report PHI candidate flows across healthcare and insurance AI prompts, RAG, tools, memory, logs, and provider b…☆204Oct 13, 2026Updated last week
- Say It Simply, Test It Properly. Agent-powered strategy research with independent ledger checks and reproducible reports.☆463Sep 27, 2026Updated 3 weeks ago
- AI agent skills for end-to-end hotel and flight booking—compare live hotel rates across leading OTAs and suppliers, search and verify rea…☆2,224Updated this week
- Teach an Open Model Everything About Your Chip☆35Aug 30, 2026Updated last month
- A curated collection of skills, practices, and tooling used throughout the project lifecycle — from development to testing and beyond.☆26May 8, 2026Updated 5 months ago
- Chinese version of Coot☆83Aug 6, 2026Updated 2 months ago
- Evaluating frontier models on real-world ai-infra engineering tasks☆57Updated this week
- ☆13Apr 9, 2025Updated last year
- efficient person image generation for re-identification application☆13Sep 7, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆20Oct 15, 2024Updated 2 years ago
- Incremental View Maintenance support for DuckDB☆18Oct 24, 2023Updated 2 years ago
- A benchmark framework for decision forest inferences☆11Jan 19, 2024Updated 2 years ago
- The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"☆17Mar 17, 2025Updated last year
- ADXL375 full-featured driver library for general-purpose MCU and Linux.☆17Updated this week
- Implementation of faster and more efficient sequence modeling deep learning algorithms based on fairseq, e.g. Lite-Transormer, Reformer, …☆37Jul 13, 2020Updated 6 years ago
- mikudos-message-pusher☆11May 15, 2020Updated 6 years ago
- ☆10Apr 22, 2020Updated 6 years ago
- ☆17Apr 6, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A tree select React component.☆12Mar 16, 2020Updated 6 years ago
- Flutter☆41Nov 18, 2019Updated 6 years ago
- [Info.Sci 2025] PMLTSVM☆42Sep 15, 2025Updated last year
- This is an Img tag developed based on Vue3 with caching function, this component will help you store all the requested images in indexedb…☆13Jun 5, 2024Updated 2 years ago
- ☆624Updated this week
- A novel system that unifies LLM serving with query optimization to efficiently process batch agentic workflows.☆16Oct 7, 2026Updated 2 weeks ago
- Rich and fast user-defined functions in relational databases☆21Sep 8, 2022Updated 4 years ago
- 本笔记基于哈工大李治军老师的课程，以及王道考研资料，B站CodeSheep的知识梳理，各大论坛的博客等，从各个渠道中获取精华，成为这些笔记。☆13Nov 26, 2020Updated 5 years ago
- [NeurIPS 25] Official Implementation of TPP-SD: Accelerating Transformer Point Process Sampling with Speculative Decoding☆48Nov 17, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- IRPV-UAV Dataset☆41Mar 24, 2026Updated 6 months ago
- ☆13Dec 5, 2022Updated 3 years ago
- mikudos-socketio-app☆13Jan 6, 2023Updated 3 years ago
- Long-Horizon Multi-Tool Agent Reinforcement Learning with Adaptive Credit Assignment☆14Aug 19, 2026Updated 2 months ago
- Foundations-of-RL-Learning-From-Scratch is a hands-on educational library providing clear, from-scratch Python implementations of foundat…☆21Updated this week
- ☆20Updated this week
- Interface oriented implementation, no coupling with the model and database, support for GC☆11May 12, 2020Updated 6 years ago