learning nano-vllm 0.11.2
☆17Dec 28, 2025Updated 5 months ago
Alternatives and similar repositories for learning-nano-vllm
Users that are interested in learning-nano-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OpenAI compatible API for open source LLMs☆17Oct 30, 2023Updated 2 years ago
- ☆16Mar 24, 2025Updated last year
- A lightweight, production-ready C++ library for LLM tokenization, fully compatible with HuggingFace tokenizer.json.☆31Jan 4, 2026Updated 5 months ago
- Signal & callback generic class for C++ applications☆11Mar 25, 2025Updated last year
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The CBuild-ng compilation system is a more powerful and flexible build system than Buildroot, and faster and succincter than Yocto. It ma…☆19Jun 4, 2026Updated 2 weeks ago
- TensorFlow Lite C precompiled library for Windows, Linux and macOS☆15Dec 30, 2024Updated last year
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- a single-header math library☆17Nov 7, 2025Updated 7 months ago
- ☆16Nov 28, 2023Updated 2 years ago
- 高性能本地化语音合成API服务，基于kokoro-onnx开发，支持中文和多语言，提供FastAPI接口与Docker部署，一键搭建私有TTS服务。☆16Jan 10, 2026Updated 5 months ago
- Distributed Load Testing of REST/gRPC APIs using Locust☆10Sep 2, 2020Updated 5 years ago
- The Gstreamer hardware encoder/decoder plugins for Rockchip platform☆13Oct 8, 2023Updated 2 years ago
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆20Sep 12, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- only contain face detect 、5/81 points 、face recognization models☆10Jul 9, 2020Updated 5 years ago
- 大模型驱动的虚拟主播☆12Mar 25, 2024Updated 2 years ago
- [SENSORS 2025] PicoSAM2 and PicoSAM3 are segmentation models running in-sensor on the Sony IMX500.☆47Apr 27, 2026Updated last month
- The web version of RapidOCR☆24Feb 27, 2026Updated 3 months ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- ☆16Jul 28, 2022Updated 3 years ago
- ☆17Jan 1, 2024Updated 2 years ago
- fatigue detect rknn/onnx model deploy in rk3568 npu（ROCK 3A）☆17Dec 24, 2023Updated 2 years ago
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆15Oct 24, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆36Updated this week
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- TenniS: Tensor based Edge Neural Network Inference System☆15May 25, 2026Updated 3 weeks ago
- The C++ project for traditional image keypoint detectors and descriptors☆16Jul 26, 2024Updated last year
- a plugin-oriented framework for video structured. 国产程序员请加微信zhzhi78拉群交流。☆18May 28, 2024Updated 2 years ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 2 years ago
- ☆14Apr 3, 2026Updated 2 months ago
- convert GitHub issues to a website☆28May 19, 2026Updated 3 weeks ago
- Inference Llama/Llama2/Llama3 Modes in NumPy☆21Nov 22, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Easy inference tool for ViTPose using ONNX☆17Feb 28, 2023Updated 3 years ago
- 🧠 Production-grade memory sidecar for AI agents — gbrain + Hindsight + 3-tier recall. Agent-agnostic, battle-tested. | 生产级外挂记忆系统，兼容Herme…☆135Updated this week
- Deb packages for gpu and vpu☆17May 21, 2026Updated 3 weeks ago
- ☆19Jan 19, 2024Updated 2 years ago
- ☆45Mar 18, 2026Updated 3 months ago
- ☆14May 6, 2024Updated 2 years ago
- Open Source Computer Vision Library☆21Sep 25, 2024Updated last year