AI Infra LLM infer/ tensorrt-llm/ vllm
☆24Aug 10, 2026Updated 2 months ago
Alternatives and similar repositories for llm-deploy
Users that are interested in llm-deploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI infer engine☆10Jul 6, 2026Updated 3 months ago
- Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda☆24Sep 10, 2026Updated last month
- An extended version of QFileSystemModel with access to parent directory☆12Feb 27, 2019Updated 7 years ago
- ☆17Sep 15, 2026Updated last month
- FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。☆26May 30, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 基于电商导购机器人，自然语言理解（NLU），文本纠错，歧义词消歧☆12May 5, 2020Updated 6 years ago
- A small, readable inference engine inspired by DeepInfer. CPU first, built for learning.☆17Oct 20, 2026Updated last week
- Microsoft Edge Microsoft Edge主页算法☆20Apr 15, 2019Updated 7 years ago
- 「城语」APP基于A级景区 、历史古迹、文物保护单位等基础数据，利用先进的大模型能力实现智能化的Citywalk 路线规划，包括设计一条路线、生成路线攻略、生成景点的推荐理由等三大核心功能；利用大模型减少了人工编辑和推荐的工作量，并可以根据游客的需求进行个性化定制，提升了游客…☆20Feb 20, 2024Updated 2 years ago
- LLM Agents: Landing Page Generation for an E-commerce Platform Using CrewAI, Groq-LangChain and Qdrant☆15May 30, 2024Updated 2 years ago
- A Python script to convert the output of NVIDIA Nsight Systems (in SQLite format) to JSON in Google Chrome Trace Event Format.☆61Aug 5, 2025Updated last year
- Voice Notes is a lightweight memo tool to make text notes and voice and audio recordings.☆13Updated this week
- 谷歌2011年开始开发的一款专注于速度的压缩，解压库，速度完胜zlib。☆14Apr 28, 2018Updated 8 years ago
- Learnings + Exercises from the PMPP book!☆11Mar 1, 2026Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 基于nodejs后端框架与Qt前端框架使用protobuf☆11Jun 17, 2016Updated 10 years ago
- Tool for generating tagged sentences from JSGF grammars☆16Dec 14, 2018Updated 7 years ago
- A sumary of MoE experimental setups across a number of different papers.☆16Feb 16, 2023Updated 3 years ago
- Ultimate Emoji Generator library for C/C++☆28May 11, 2026Updated 5 months ago
- Web bulk registration framework: Camoufox + shareable Site Packs + AI CLI☆16Aug 10, 2026Updated 2 months ago
- ☆20Oct 9, 2023Updated 3 years ago
- Prototyper is a desktop application to make UI prototypes☆10Oct 1, 2026Updated 3 weeks ago
- 基于 Qt 5.6 的多标签网页浏览器☆10Apr 28, 2018Updated 8 years ago
- Cumcord installer written in Go using Frenyard.☆13Apr 9, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This repository has been created as part of the kaggleXBIPOC Mentorship Program. The aim of this project is to establish the sentiment a…☆11Mar 18, 2023Updated 3 years ago
- Simple DLL injection protect with the idea of hooking the LoadLibrary function and failing it if it is a call for an unauthorized DLL.☆11Nov 15, 2023Updated 2 years ago
- 思考与总结☆10Feb 18, 2016Updated 10 years ago
- ffplay from ffmpeg, with compile-time options to disable features☆10Apr 15, 2017Updated 9 years ago
- Inference speed-up for stable-diffusion (ldm) with TensorRT.☆35Jun 19, 2023Updated 3 years ago
- 📦 eCAL C/C++ runtime core☆12Oct 21, 2024Updated 2 years ago
- ☆17Jun 10, 2025Updated last year
- Geek Car, An Autonomous Application Based On Cyber RT http://for-geeks.com☆13Feb 5, 2026Updated 8 months ago
- ☆13Mar 25, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Ament task provider extension for vscode☆10Updated this week
- A localhost-only ROS 2 RMW — AF_UNIX sockets + lock-free shared-memory discovery, no DDS, no daemon, no broker. Built to scale.☆17Updated this week
- A universal VNC server+client framework☆13Jun 5, 2020Updated 6 years ago
- Autogeneration of Python bindings from manually annotated C++ headers☆12Jul 24, 2020Updated 6 years ago
- pytorch implementation of DeepSeek Engram☆19Mar 24, 2026Updated 7 months ago
- Visualize the Expert Parallelism Load Balancer☆18Mar 15, 2025Updated last year
- A python version of guacamole-client project, built on top of Django☆11Oct 22, 2017Updated 9 years ago