A lightweight and high-performance service module that helps MindSpore developers efficiently deploy online inference services in the production environment.
☆41Jun 24, 2025Updated 8 months ago
Alternatives and similar repositories for serving
Users that are interested in serving are comparing it to the libraries listed below
Sorting:
- A connecting link module between frontends and Ascend processors.☆87Jul 1, 2025Updated 8 months ago
- AKG (Auto Kernel Generator) is an optimizer for operators in Deep Learning Networks, which provides the ability to automatically fuse ops…☆244Dec 13, 2025Updated 2 months ago
- MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.☆4,677Jul 29, 2024Updated last year
- 基于MindSpore的TinyRAG实现☆19Dec 31, 2024Updated last year
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆20Sep 12, 2024Updated last year
- Whisper in TensorRT-LLM☆17Sep 21, 2023Updated 2 years ago
- Learning problem-solving, logic/set, math, physics, economics through functional programming using Haskell☆19Oct 16, 2015Updated 10 years ago
- Free ChatGPT API Key，免费ChatGPT API，支持GPT4 API，ChatGPT国内可用免费转发API，直连无需代理。☆13Aug 28, 2024Updated last year
- GUI for GHRepoSearcher. It allows to search online repositories on github.☆10May 20, 2022Updated 3 years ago
- ☆20Feb 28, 2026Updated last week
- Text editors made for VNoteX.☆41Oct 27, 2025Updated 4 months ago
- The Process Watchdog is a Linux-based utility designed to start, monitor and manage processes specified in a configuration file. It ensur…☆11Dec 27, 2025Updated 2 months ago
- cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server a…☆42Jul 4, 2025Updated 8 months ago
- Qt/Qml application using Google speech-to-text API to make voice commands☆11Jan 19, 2020Updated 6 years ago
- training for VOC dataset☆11Nov 7, 2019Updated 6 years ago
- Qt In-App Purchasing API☆18Oct 31, 2025Updated 4 months ago
- Symbian Dropbox Client☆14Jul 22, 2022Updated 3 years ago
- QT wrapper classses for FFmpeg☆10May 28, 2016Updated 9 years ago
- CMake modules for quickly importing third-party libraries by fetchcontent.☆12Jun 1, 2025Updated 9 months ago
- A simple process query/manipulation tool using driver hooked system call. (2019)☆12Aug 30, 2021Updated 4 years ago
- Implementation of our paper published in Springer's Signal, Image and Video Processing☆11Dec 5, 2020Updated 5 years ago
- LLM inference in C/C++☆25Updated this week
- Comparing Different Stochastic Gradien Descent implementations in Haskell against Python☆10Jul 25, 2016Updated 9 years ago
- Oracle Berkeley DB 18.x (Private copy of official distribution)☆11Jul 23, 2020Updated 5 years ago
- 从Docker官方Ubuntu镜像，定制中国地区使用的对应镜像。☆13Jan 13, 2021Updated 5 years ago
- ☆15Mar 4, 2017Updated 9 years ago
- NBT file editor for Minecraft☆11Jan 29, 2026Updated last month
- Library for Object Linking and Embedding (OLE) data types☆12Nov 27, 2025Updated 3 months ago
- ☆36Dec 18, 2024Updated last year
- A tiny C compiler based on LLVM and ANTLR4☆10Jan 13, 2019Updated 7 years ago
- (翻译)JavaScript轻量级函数式编程☆14Sep 30, 2019Updated 6 years ago
- 大模型驱动的虚拟主播☆12Mar 25, 2024Updated last year
- An interactive utility that breaks the interdependency between deep learning and coding☆11Aug 30, 2020Updated 5 years ago
- Get an answer to a question from multiple backend engine like Google, wolframalpha or DuckDuckGo☆11Dec 9, 2020Updated 5 years ago
- SQLite FTS5 中文单字分词器。☆10Apr 11, 2022Updated 3 years ago
- Dependency-free and header-only C++11 XGen XPD cache I/O library.☆13Jun 23, 2019Updated 6 years ago
- tools for creating, inspecting and modifying torrent files☆13Jun 1, 2022Updated 3 years ago
- 10 years after the downfall of the TRiAS GmbH in Germany it's definitely time to release the sources of the TRiAS Spatial Information Sys…☆11Nov 11, 2012Updated 13 years ago