AI Infra LLM infer/ tensorrt-llm/ vllm
☆24Jun 7, 2026Updated last week
Alternatives and similar repositories for llm-deploy
Users that are interested in llm-deploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda☆23Jun 10, 2026Updated last week
- FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。☆25May 30, 2024Updated 2 years ago
- [ICLR 2026] Official implementation of DiCache: Let Diffusion Model Determine Its Own Cache☆62Jan 26, 2026Updated 4 months ago
- M78星云机场官网地址☆13Nov 20, 2025Updated 6 months ago
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆20Jun 1, 2023Updated 3 years ago
- 📦 eCAL C/C++ runtime core☆12Oct 21, 2024Updated last year
- Geek Car, An Autonomous Application Based On Cyber RT http://for-geeks.com☆13Feb 5, 2026Updated 4 months ago
- A repository for all the STRANDS-augmented movebase, including 3D obstacle avoidance, etc.☆10Nov 26, 2019Updated 6 years ago
- Flexible and Pluggable Serving Engine for Diffusion LLMs☆71Updated this week
- A High-Level DRAM Timing, Power and Area Exploration Tool☆31Jul 29, 2020Updated 5 years ago
- B-Roll: Video data in rosbag2 plugins and utilities☆12Nov 19, 2025Updated 7 months ago
- 第一代个人机械臂，欢迎PR☆39Jun 9, 2025Updated last year
- 思考与总结☆10Feb 18, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- SimplePIM is the first high-level programming framework for real-world processing-in-memory (PIM) architectures. Described in the PACT 20…☆35Oct 23, 2023Updated 2 years ago
- ☆14Aug 15, 2025Updated 10 months ago
- ☆12Apr 29, 2026Updated last month
- Framework for creating ROS dashboards in RQT☆13Jan 26, 2026Updated 4 months ago
- Simple example application to show how to allocate dmabufs from user space (from a dmabuf heap) and use them for v4l2 capture.☆16Aug 2, 2023Updated 2 years ago
- Simple example of using pybind11 via Bazel.☆11Apr 30, 2020Updated 6 years ago
- Examples of using Isaac ROS GEMs together☆19May 1, 2026Updated last month
- Tensorflow code for WACV 2019 paper "Attention Based Natural Language Grounding by Navigating Virtual Environment" - https://arxiv.org/ab…☆17Nov 7, 2018Updated 7 years ago
- Provides a demo of micro-ROS based on ST Disco L475 IOT01 board.☆13Jul 14, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Easily batch-build cmake projects!☆18Jan 16, 2026Updated 5 months ago
- ONNX Python Examples☆16Sep 13, 2022Updated 3 years ago
- ros2_v4l2_camera with shm_msg based zero-copy and more!☆14Dec 8, 2022Updated 3 years ago
- PiCAS executor + ROS 2 Real-Time Working Group's reference system☆12Oct 4, 2023Updated 2 years ago
- RMW implementation for EmbeddedRTPS middleware☆16Apr 21, 2023Updated 3 years ago
- learning materials of driveos from nvidia drive sdk.☆11Jun 10, 2026Updated last week
- 🔴 Accelerated GStreamer utilities for NVIDIA Jetson Nano.☆10May 8, 2021Updated 5 years ago
- Rust wrapper for Eclipse iceoryx™ - true zero-copy inter-process-communication☆14Sep 14, 2021Updated 4 years ago
- ROS2 package that allows recording without interprocess communication☆19Apr 16, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ROS2 image transport plugin using libav(ffmpeg) for generating foxglove CompressedVideo messages☆12Oct 20, 2025Updated 7 months ago
- A simulator for SK hynix AiM PIM architecture based on Ramulator 2.0☆65Jul 22, 2025Updated 10 months ago
- aiml的C++实现，支持中文，改自libaiml☆16Dec 2, 2012Updated 13 years ago
- ROS Graph Monitor - libraries and nodes to check the ROS application structure as a whole☆36Jun 2, 2026Updated 2 weeks ago
- GeoJSON for Modern C++☆16Mar 22, 2026Updated 2 months ago
- Depict GPU memory footprint during DNN training of PyTorch☆11Nov 17, 2022Updated 3 years ago
- Catkin version of https://bitbucket.org/daniel_dube/bagedit, which are scripts to manage ROS bag files.☆15Nov 23, 2023Updated 2 years ago