AI infer engine
☆10Jul 6, 2026Updated 4 months ago
Alternatives and similar repositories for xinfer
Users that are interested in xinfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Infra LLM infer/ tensorrt-llm/ vllm☆24Aug 10, 2026Updated 2 months ago
- Agent skills for long-horizon work: turn goals into verified results, and lessons into better runs.☆12Oct 22, 2026Updated 2 weeks ago
- Source-code level analysis of LLM RL training infra: async RL, weight sync, FP8, MoE routing | LLM RL 训练基础设施源码级分析☆15Sep 8, 2026Updated last month
- Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda☆24Updated this week
- ☆22Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆24Jun 29, 2026Updated 4 months ago
- a mllm inference engine for academic research☆24Jan 30, 2026Updated 9 months ago
- Traditional image processing algorithms implemented by CUDA.☆14Feb 23, 2025Updated last year
- Creating AI agents with the simplicity of Python in Java.☆14Mar 21, 2026Updated 7 months ago
- Simple, Fast, Parallel Huggingface GGML model downloader written in python☆24Jul 26, 2023Updated 3 years ago
- A Python script to convert the output of NVIDIA Nsight Systems (in SQLite format) to JSON in Google Chrome Trace Event Format.☆61Aug 5, 2025Updated last year
- The repository supports TensorRT, QNN platform inference, 2D obstacle detection yolo series (yolov5, yolov8, yolo11, yolox), semantic seg…☆20May 6, 2025Updated last year
- Reduce your LLM costs by 40-70% automatically. Routes prompts locally, compacts context, tracks real savings.☆15Apr 27, 2026Updated 6 months ago
- Tool to collect debug logs from NVIDIA server components, in band and out-of-band.☆11Oct 15, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Ultimate Emoji Generator library for C/C++☆28May 11, 2026Updated 5 months ago
- ☆13Jan 28, 2026Updated 9 months ago
- 将端上模型部署过程中，常见的问题以及解决办法记录并汇总，希望能给其他人带来一点帮助。☆23Aug 17, 2022Updated 4 years ago
- mnn asr demo.☆27Mar 24, 2025Updated last year
- Graph-based C++ runtime for building and executing AI, ML, and computer vision pipelines across devices.☆15Jun 29, 2026Updated 4 months ago
- A repository for all the STRANDS-augmented movebase, including 3D obstacle avoidance, etc.☆10Nov 26, 2019Updated 6 years ago
- Simple agent framework using Ollama tool calling☆10Aug 27, 2024Updated 2 years ago
- Inference speed-up for stable-diffusion (ldm) with TensorRT.☆35Jun 19, 2023Updated 3 years ago
- ☆12Feb 10, 2026Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Storage Performance Development Kit☆12Updated this week
- A model-agnostic GPU runtime for shipping models as verified programs.☆165Updated this week
- 📦 eCAL C/C++ runtime core☆12Oct 21, 2024Updated 2 years ago
- B-Roll: Video data in rosbag2 plugins and utilities☆12Nov 19, 2025Updated 11 months ago
- A full-stack AI engineering playbook — model foundations, post-training, AI infrastructure, RAG, agents, memory, MCP, evaluation, and pro…☆16Sep 22, 2026Updated last month
- New MLIR dialect, attributes, and transformations for generating host driver code for AXI-based linalg accelerators.☆11Jan 8, 2024Updated 2 years ago
- A localhost-only ROS 2 RMW — AF_UNIX sockets + lock-free shared-memory discovery, no DDS, no daemon, no broker. Built to scale.☆17Updated this week
- Lightweight OpenCV-style API with pluggable AI inference backends (TensorFlow Lite, ONNX Runtime, MNN) for edge and mobile vision.☆29Jan 26, 2026Updated 9 months ago
- Ament task provider extension for vscode☆10Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- NVLink microbenchmark with IBM Power8 and NVIDIA P100 GPU - Master Thesis☆11Aug 23, 2017Updated 9 years ago
- A rosbag-compatible MCAP writer for rmw_zenoh☆13Dec 5, 2025Updated 11 months ago
- Gallatin is a general-purpose memory manager for CUDA that allows for threads to quickly malloc and free memory of arbitrary size inside …☆28Jul 20, 2026Updated 3 months ago
- ☆10Aug 27, 2025Updated last year
- VastModelZOO 是瀚博半导体VastAI-AIS团队维护的AI模型库，提供了人工智能多个领域（CV、AUDIO、NLP、LLM、MLLM等）的开源模型在瀚博训推芯片上的部署、训练示例。☆30Oct 29, 2026Updated last week
- A desktop GUI for Flux 1.1 Pro built using DelphiFMX For Python☆11Oct 5, 2024Updated 2 years ago
- Font independent text analysis support for shaping and layout.☆15May 28, 2026Updated 5 months ago