AI Infra LLM infer/ tensorrt-llm/ vllm
☆24Aug 10, 2026Updated 2 weeks ago
Alternatives and similar repositories for llm-deploy
Users that are interested in llm-deploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda☆24Jul 28, 2026Updated last month
- FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。☆25May 30, 2024Updated 2 years ago
- A lightweight and easy to use async IO library implemented with io_uring and C++20 coroutine.☆15Feb 11, 2025Updated last year
- ☆11Jan 9, 2019Updated 7 years ago
- LLM Agents: Landing Page Generation for an E-commerce Platform Using CrewAI, Groq-LangChain and Qdrant☆15May 30, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Aug 4, 2026Updated 3 weeks ago
- ☆15Sep 24, 2019Updated 6 years ago
- Multi-view Spectral Clustering on Conflicting Views☆15Jul 12, 2017Updated 9 years ago
- 📦 eCAL C/C++ runtime core☆12Oct 21, 2024Updated last year
- Geek Car, An Autonomous Application Based On Cyber RT http://for-geeks.com☆13Feb 5, 2026Updated 6 months ago
- Inference speed-up for stable-diffusion (ldm) with TensorRT.☆35Jun 19, 2023Updated 3 years ago
- ☆20Oct 9, 2023Updated 2 years ago
- The ComponentContainer and Executor that assign a dedicated thread for each callback group.☆10Jun 20, 2025Updated last year
- ☆17Jun 10, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 用大模型批量处理数据，现支持各种大模型做OCR，支持通义千问, 月之暗面, 百度飞桨OCR, OpenAI 和LLAVA。Use LLM to generate or clean data for academic use. Support OCR with qwen, m…☆18Sep 15, 2024Updated last year
- Ament task provider extension for vscode☆10Updated this week
- ☆24Jan 4, 2022Updated 4 years ago
- deepseek思维树模式实现☆23Jul 17, 2025Updated last year
- ☆14Jan 6, 2020Updated 6 years ago
- Visualize the Expert Parallelism Load Balancer☆19Mar 15, 2025Updated last year
- ☆14Jul 31, 2026Updated 3 weeks ago
- Awesome Object Detection based on handong1587 github: https://handong1587.github.io/deep_learning/2015/10/09/object-detection.html☆18May 31, 2019Updated 7 years ago
- Framework for creating ROS dashboards in RQT☆13Jan 26, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆186Jul 12, 2024Updated 2 years ago
- ONNX Python Examples☆16Sep 13, 2022Updated 3 years ago
- Provides a demo of micro-ROS based on ST Disco L475 IOT01 board.☆13Jul 14, 2021Updated 5 years ago
- Python标准库☆19Oct 12, 2016Updated 9 years ago
- 使用 python、Latex 绘制神经网络架构图。☆20Jun 2, 2022Updated 4 years ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated last year
- ros2_v4l2_camera with shm_msg based zero-copy and more!☆14Dec 8, 2022Updated 3 years ago
- PiCAS executor + ROS 2 Real-Time Working Group's reference system☆12Oct 4, 2023Updated 2 years ago
- ROS2 image transport plugin using libav(ffmpeg) for generating foxglove CompressedVideo messages☆14Jun 29, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Sep 10, 2025Updated 11 months ago
- Rust wrapper for Eclipse iceoryx™ - true zero-copy inter-process-communication☆14Sep 14, 2021Updated 4 years ago
- 🔴 Accelerated GStreamer utilities for NVIDIA Jetson Nano.☆10May 8, 2021Updated 5 years ago
- CUDA Templates for Linear Algebra Subroutines☆102Apr 25, 2024Updated 2 years ago
- Simple KV storage with Raft consensus algorithm inside☆21Nov 21, 2022Updated 3 years ago
- aiml的C++实现，支持中文，改自libaiml☆16Dec 2, 2012Updated 13 years ago
- ☆12Jun 23, 2022Updated 4 years ago