Qwen3.5-Thor — High-performance BF16/NVFP4 inference engine for Qwen3.5 model family on NVIDIA Jetson AGX Thor (SM110a Blackwell). C++17/CUDA, Ollama/OpenAI compatible API.
☆13Apr 2, 2026Updated 7 months ago
Alternatives and similar repositories for qwen35-thor
Users that are interested in qwen35-thor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Execution-state orchestration layer for FlashRT: model-runtime adoption, stage-DAG scheduling, RTC action chunks, and capsule state contr…☆13Sep 7, 2026Updated 2 months ago
- [CoRL'26 Spotlight] Inference engine of "EagleVLA: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference".…☆65Oct 23, 2026Updated 3 weeks ago
- ☆10Jul 28, 2021Updated 5 years ago
- 使用cuda实现类似sahi库的切图☆13Jul 21, 2026Updated 3 months ago
- ☆29Aug 19, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆37Oct 16, 2026Updated last month
- Multiple Lidar preprocessor for BEVfusion☆11Aug 25, 2023Updated 3 years ago
- ⚡ 轻量级 C++20 任务并行与 DAG 调度库☆17Updated this week
- FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is prod…☆13May 20, 2026Updated 5 months ago
- ⚡️Qwen-Image 4.8x🎉 speedup with Hybrid Acceleration for low VRAM GPUs☆17Oct 24, 2025Updated last year
- 重构nerf代码,更加容易读懂☆13Mar 26, 2023Updated 3 years ago
- a ai infra framework for edge device base on nndeploy☆17Nov 27, 2025Updated 11 months ago
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 3 years ago
- ☆31Aug 25, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆14Apr 18, 2023Updated 3 years ago
- Step-by-Step Guide to Use SGLang on NVIDIA Jetson Orin platform☆13Jan 27, 2025Updated last year
- minimal Vision Language Action framework for robot control systems☆17Sep 15, 2025Updated last year
- A CUDA kernel for NHWC GroupNorm for PyTorch☆26Nov 15, 2024Updated 2 years ago
- This project is primarily used to deploy large language models and multimodal large models on Orin.🚀🚀🚀☆18Jun 23, 2026Updated 4 months ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法,并重写预处理和后处理部分,具有超高性能!让你在Intel CPU平台上的检测速度起飞! 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度,推理速度更快!☆16Jun 14, 2023Updated 3 years ago
- LLM Inference FrameWork☆40Oct 21, 2026Updated 3 weeks ago
- 跟着Tensorrt_pro学习各种知识☆39Nov 25, 2022Updated 3 years ago
- CenterPoint model trained with MMDetection3d on custom dataset, and deployed with TensorRT☆35Mar 15, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆67Feb 15, 2026Updated 9 months ago
- 3d object detection model smoke c++ inference code☆39Dec 1, 2022Updated 3 years ago
- ☆25Oct 10, 2022Updated 4 years ago
- ☆19Aug 23, 2022Updated 4 years ago
- apollo r3.0 感知移植(参考百度开发者套件)☆19Oct 29, 2019Updated 7 years ago
- Official implementation of ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Models☆23Jun 19, 2026Updated 4 months ago
- Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda☆24Nov 6, 2026Updated last week
- FlashRT-HF-kernels contains standalone FlashRT CUDA/CUTLASS kernels prepared for the Hugging Face kernels community, focusing on small-ba…☆27Aug 21, 2026Updated 2 months ago
- ☆23Aug 20, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆25May 26, 2026Updated 5 months ago
- ☆47Nov 14, 2023Updated 3 years ago
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated last year
- TTG: Template Task Graph C++ API☆27Oct 29, 2026Updated 2 weeks ago
- 对 tensorRT_Pro 开源项目理解☆22Feb 23, 2023Updated 3 years ago
- ☆17Nov 14, 2023Updated 3 years ago
- Detection and Tracking ROS node based on CenterPoint and Kalman Filter☆24Feb 24, 2024Updated 2 years ago
Are these results useful?