EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆50Apr 17, 2024Updated last year
Alternatives and similar repositories for edge-infer
Users that are interested in edge-infer are comparing it to the libraries listed below
Sorting:
- Portable LLM - A rust library for LLM inference☆11Apr 13, 2024Updated last year
- An excel-like spreadsheet component for SQLPage☆16Aug 4, 2025Updated 7 months ago
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- Showing the relationship between ImageNet ID and labels and pytorch pre-trained model output ID and labels☆10Oct 11, 2020Updated 5 years ago
- CoUnit，一个基于 LLM 的虚拟团队接口人（API），通过向量化文档、知识库、SDK和 API 等，结合 LLM 智能化团队间对接与协作。Merge artificial intelligence seamlessly with team collaboration.…☆30Mar 29, 2024Updated last year
- 适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答☆14Jun 5, 2024Updated last year
- ChocoBuilder (Chocolate Factory) is a cutting-edge LLM toolkit designed to empower you in creating your very own AI assistant.Chocolate F…☆223Jul 24, 2024Updated last year
- ☆13Nov 4, 2023Updated 2 years ago
- implement llava using candle☆15Jun 9, 2024Updated last year
- JAX bindings for the flash-attention3 kernels☆21Jan 2, 2026Updated 2 months ago
- Implementation of IBC modules by `ibc-rs` that can run with Sovereign SDK rollups☆22Jun 21, 2024Updated last year
- A Triton JIT runtime and ffi provider in C++☆32Updated this week
- 基于 CUDA Driver API 的 cuda 运行时环境☆15Jul 30, 2025Updated 7 months ago
- Shire Lang Spring/Java Demo project☆18Jan 14, 2025Updated last year
- Low-security temporary experimental application-specific blockchains☆16Apr 17, 2020Updated 5 years ago
- Interface Driven Distributed Data Service☆28Jan 17, 2025Updated last year
- Your AI Copilot in Rust☆49Dec 17, 2023Updated 2 years ago
- Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model☆23Sep 26, 2024Updated last year
- Uniswap-inspired automated market-maker (AMM) protocol powered by Smart Contracts on the Orai blockchain.☆22Mar 18, 2025Updated 11 months ago
- MQTT broker☆11Jan 7, 2026Updated last month
- 🤖 AI-Powered Chinese Stock Market Analysis. 一个基于AI的A股智能分析系统，提供技术分析、交易信号和智能投资建议。☆17Jan 26, 2026Updated last month
- example of using CoreML from c++☆24Jun 14, 2023Updated 2 years ago
- ☆24Jun 27, 2023Updated 2 years ago
- WASM DRS - WASM Dymension Rollapp Standard☆32Jan 29, 2026Updated last month
- The OpenAI Rust library provides convenient access to the OpenAI API from Rust applications.☆32Nov 20, 2024Updated last year
- Eth Contract Monitor☆31Apr 15, 2025Updated 10 months ago
- A parser for OpenGL Shader Language source files☆25Aug 13, 2025Updated 6 months ago
- Gradio Interface using ffmpeg to convert media☆31Oct 14, 2024Updated last year
- Implementation-agnostic git-like hashes and history for Ruby objects☆145Aug 21, 2024Updated last year
- Library for quick and convenient creation of activities such as "About Us" or "Settings". With its help you can easily add references to …☆12Dec 3, 2020Updated 5 years ago
- 《商业数据分析》的授课课件（包含作业）☆14Sep 20, 2025Updated 5 months ago
- ☆10May 15, 2022Updated 3 years ago
- A sample REST application to help testers learn to write API automation☆11Jun 12, 2024Updated last year
- Rust Daily Learning and Work Assistant☆33Jun 26, 2023Updated 2 years ago
- Modular Rust transformer/LLM library using Candle☆38May 5, 2024Updated last year
- 📖 A service for reading long-form content on any device☆95Mar 9, 2024Updated last year
- An AI agent framework which uses hawkinsdb as long term memory☆36Feb 26, 2025Updated last year
- ☆33Apr 26, 2024Updated last year
- Some experiments… and maybe a surprise coming.☆33Nov 10, 2018Updated 7 years ago