AI Infra LLM infer/ tensorrt-llm/ vllm
☆24Aug 10, 2026Updated 3 months ago
Alternatives and similar repositories for llm-deploy
Users that are interested in llm-deploy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI infer engine☆10Jul 6, 2026Updated 4 months ago
- Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda☆24Nov 6, 2026Updated 2 weeks ago
- It's a lightwight, open-source dictionary software with a open dict format that you can make your own dictionary, being a cross platform …☆67Nov 13, 2026Updated last week
- More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression(EMNLP 2025)☆12Jan 15, 2025Updated last year
- 基于电商导购机器人,自然语言理解(NLU),文本纠错,歧义词消歧☆12May 5, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- advanced python filesystem☆12Oct 12, 2026Updated last month
- An extended version of QFileSystemModel with access to parent directory☆12Feb 27, 2019Updated 7 years ago
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- Implementation example of Distributed Tensorflow☆10Jul 22, 2017Updated 9 years ago
- Microsoft Edge Microsoft Edge主页算法☆20Apr 15, 2019Updated 7 years ago
- ☆11Jan 9, 2019Updated 7 years ago
- ☆14Sep 24, 2019Updated 7 years ago
- ☆11Jun 10, 2016Updated 10 years ago
- Voice Notes is a lightweight memo tool to make text notes and voice and audio recordings.☆13Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Dec 1, 2023Updated 2 years ago
- Applying the machine learning tool "DeOldify" on videos, frame by frame.☆17Nov 1, 2026Updated 2 weeks ago
- A Python script to convert the output of NVIDIA Nsight Systems (in SQLite format) to JSON in Google Chrome Trace Event Format.☆61Aug 5, 2025Updated last year
- 实时音频转字幕,支持完全离线,包含语音识别和机器翻译☆11Apr 12, 2025Updated last year
- ☆12Jan 3, 2022Updated 4 years ago
- A sumary of MoE experimental setups across a number of different papers.☆17Feb 16, 2023Updated 3 years ago
- Ultimate Emoji Generator library for C/C++☆28May 11, 2026Updated 6 months ago
- 基于c++实现的分布式文件传输系统☆11May 27, 2023Updated 3 years ago
- 「城语」APP基于A级景区、历史古迹、文物保护单位等基础数据,利用先进的大模型能力实现智能化的Citywalk 路线规划,包括设计一条路线、生成路线攻略、生成景点的推荐理由等三大核心功能;利用大模型减少了人工编辑和推荐的工作量,并可以根据游客的需求进行个性化定制,提升了游客…☆20Feb 20, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Use AI to automate reverse engineering and protocol analysis as much as possible, and to assist with reviewing large-scale obfuscated cod…☆15Jul 30, 2026Updated 3 months ago
- ☆17Sep 15, 2026Updated 2 months ago
- 基于 Qt 的滑动菜单☆10Oct 18, 2017Updated 9 years ago
- Prototyper is a desktop application to make UI prototypes☆10Oct 1, 2026Updated last month
- 基于 python3+ django2.2的前后端分离模板☆11Nov 22, 2022Updated 3 years ago
- 基于 Qt 5.6 的多标签网页浏览器☆10Apr 28, 2018Updated 8 years ago
- LLM Agents: Landing Page Generation for an E-commerce Platform Using CrewAI, Groq-LangChain and Qdrant☆15May 30, 2024Updated 2 years ago
- 基于DXGI、WASAPI、FFMPEG封装的录屏程序,60帧1080p高码率录制cpu占用5%左右☆12Jul 6, 2022Updated 4 years ago
- This unofficial LaTeX package provides a class for creating documents for people working with Nankai University. Updated to 2026/05/28.☆11May 28, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Simple DLL injection protect with the idea of hooking the LoadLibrary function and failing it if it is a call for an unauthorized DLL.☆11Nov 15, 2023Updated 3 years ago
- A small, readable inference engine inspired by DeepInfer. CPU first, built for learning.☆17Oct 20, 2026Updated last month
- ffplay from ffmpeg, with compile-time options to disable features☆10Apr 15, 2017Updated 9 years ago
- Graph-based C++ runtime for building and executing AI, ML, and computer vision pipelines across devices.☆15Jun 29, 2026Updated 4 months ago
- Learn from Experience skill 是让 Agent 从经验中学习 -- 纠正过的错误不再重犯,好的方法自动沉淀,越用越懂你。原理是基于你跟Agent交互中的经验(踩坑、纠正、好方法)记下来、整理好、用起来,不再随会话结束而消失。☆20Jul 29, 2026Updated 3 months ago
- A GPU accelerated error-bounded lossy compression for scientific data.☆103Oct 5, 2026Updated last month
- 📦 eCAL C/C++ runtime core☆12Oct 21, 2024Updated 2 years ago
Are these results useful?