AI Infra LLM infer/ tensorrt-llm/ vllm
☆24Aug 10, 2026Updated 2 months ago
Alternatives and similar repositories for llm-deploy
Users that are interested in llm-deploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda☆24Sep 10, 2026Updated last month
- advanced python filesystem☆12Updated this week
- 「城语」APP基于A级景区、历史古迹、文物保护单位等基础数据，利用先进的大模型能力实现智能化的Citywalk 路线规划，包括设计一条路线、生成路线攻略、生成景点的推荐理由等三大核心功能；利用大模型减少了人工编辑和推荐的工作量，并可以根据游客的需求进行个性化定制，提升了游客…☆19Feb 20, 2024Updated 2 years ago
- ☆11Jan 9, 2019Updated 7 years ago
- This unofficial LaTeX package provides a class for creating documents for people working with Nankai University. Updated to 2026/05/28.☆11May 28, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 📦 eCAL C/C++ runtime core☆12Oct 21, 2024Updated last year
- ☆20Jun 1, 2023Updated 3 years ago
- Geek Car, An Autonomous Application Based On Cyber RT http://for-geeks.com☆13Feb 5, 2026Updated 8 months ago
- Inference speed-up for stable-diffusion (ldm) with TensorRT.☆35Jun 19, 2023Updated 3 years ago
- A repository for all the STRANDS-augmented movebase, including 3D obstacle avoidance, etc.☆10Nov 26, 2019Updated 6 years ago
- The ComponentContainer and Executor that assign a dedicated thread for each callback group.☆10Jun 20, 2025Updated last year
- ☆17Jun 10, 2025Updated last year
- B-Roll: Video data in rosbag2 plugins and utilities☆12Nov 19, 2025Updated 10 months ago
- Ament task provider extension for vscode☆10Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A High-Level DRAM Timing, Power and Area Exploration Tool☆32Jul 29, 2020Updated 6 years ago
- ☆14Jan 6, 2020Updated 6 years ago
- Visualize the Expert Parallelism Load Balancer☆17Mar 15, 2025Updated last year
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆19Jul 10, 2025Updated last year
- ☆15Jul 31, 2026Updated 2 months ago
- Codebase of Truncated Consistency Models (ICLR 2025)☆34Jan 24, 2025Updated last year
- Framework for creating ROS dashboards in RQT☆13Jan 26, 2026Updated 8 months ago
- Docker + PaddleOCR + FastAPI☆28Feb 1, 2023Updated 3 years ago
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM☆186Jul 12, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ONNX Python Examples☆16Sep 13, 2022Updated 4 years ago
- Provides a demo of micro-ROS based on ST Disco L475 IOT01 board.☆13Jul 14, 2021Updated 5 years ago
- Isolates any given process using the unshare system call. Suited for ROS, though can work for any process.☆13Jan 31, 2024Updated 2 years ago
- 使用 python、Latex 绘制神经网络架构图。☆19Jun 2, 2022Updated 4 years ago
- ☆15Jun 20, 2025Updated last year
- SimplePIM is the first high-level programming framework for real-world processing-in-memory (PIM) architectures. Described in the PACT 20…☆39Oct 23, 2023Updated 2 years ago
- ros2_v4l2_camera with shm_msg based zero-copy and more!☆14Dec 8, 2022Updated 3 years ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models☆25Oct 5, 2024Updated 2 years ago
- PiCAS executor + ROS 2 Real-Time Working Group's reference system☆12Oct 4, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ROS2 image transport plugin using libav(ffmpeg) for generating foxglove CompressedVideo messages☆13Jun 29, 2026Updated 3 months ago
- ☆13Sep 10, 2025Updated last year
- learning materials of driveos from nvidia drive sdk.☆13Jun 10, 2026Updated 4 months ago
- Rust wrapper for Eclipse iceoryx™ - true zero-copy inter-process-communication☆14Sep 14, 2021Updated 5 years ago
- 🔴 Accelerated GStreamer utilities for NVIDIA Jetson Nano.☆10May 8, 2021Updated 5 years ago
- Catkin version of https://bitbucket.org/daniel_dube/bagedit, which are scripts to manage ROS bag files.☆15Nov 23, 2023Updated 2 years ago
- Abstract 2D multi-robot multi-interface mobile robot simulator (fork of MobileSim simulator with various fixes, optimizations, and added …☆16May 30, 2023Updated 3 years ago