EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆51Apr 17, 2024Updated 2 years ago
Alternatives and similar repositories for edge-infer
Users that are interested in edge-infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Port of Helix MP3 code to ESP8266☆14Dec 8, 2017Updated 8 years ago
- ChocoBuilder (Chocolate Factory) is a cutting-edge LLM toolkit designed to empower you in creating your very own AI assistant.Chocolate F…☆224Jul 24, 2024Updated 2 years ago
- This code is part of a workshop conducted on how to build your own Document AI Agent using Open Source LLMs☆17May 8, 2025Updated last year
- 适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答☆13Jun 5, 2024Updated 2 years ago
- ☆14Jul 22, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- source code for roleplaygateway.com☆11Aug 17, 2023Updated 3 years ago
- Simple Prompt Plugin is a plugin for Obsidian that allows you generate content in your notes using LLMs.☆15Jun 16, 2024Updated 2 years ago
- 适用于sophon bm1684x的Langchain-Chatchat，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答☆18May 23, 2024Updated 2 years ago
- Nano Bots for Obsidian: small, AI-powered bots that can be easily shared as a single file, designed to support multiple providers such as…☆15Jan 13, 2024Updated 2 years ago
- 基于 CUDA Driver API 的 cuda 运行时环境☆16Jul 30, 2025Updated last year
- Low-security temporary experimental application-specific blockchains☆17Apr 17, 2020Updated 6 years ago
- ☆11Mar 6, 2023Updated 3 years ago
- Arduino/ESP32 bluetooth controlled toy using buttplug/intiface☆12Mar 23, 2024Updated 2 years ago
- Android app for the Hole in your Palm project, making LLMs accessible on-device!☆19May 3, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of IBC modules by `ibc-rs` that can run with Sovereign SDK rollups☆21Jun 21, 2024Updated 2 years ago
- A Free and Open source application that turns your mobile device into a remote gamepad for your computer. This is the client.☆19Jul 31, 2022Updated 4 years ago
- implement llava using candle☆15Jun 9, 2024Updated 2 years ago
- Showing the relationship between ImageNet ID and labels and pytorch pre-trained model output ID and labels☆10Oct 11, 2020Updated 6 years ago
- GenKit is a library that abstracts away all the differences across generative AI platforms.☆75Sep 13, 2025Updated last year
- Developing a high-precision legal expert LLM application called Contract Advisor RAG. The project's goal is to create a Retrieval Augment…☆15Apr 10, 2024Updated 2 years ago
- Your AI Copilot in Rust☆51Dec 17, 2023Updated 2 years ago
- Magnifier for hyprland (Tested on Ubuntu)☆10Mar 25, 2025Updated last year
- DACO - Decentralized autonomous charity organization☆10Dec 11, 2017Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- React Sortable☆12Apr 12, 2024Updated 2 years ago
- OminiX API Server to support LLM, image, ASR and TTS☆34Aug 17, 2026Updated last month
- A simple Android editor for pixel arts, images, animations.☆15Jun 17, 2025Updated last year
- Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model☆23Sep 26, 2024Updated 2 years ago
- Experience the perfect balance of gaming optimization and battery efficiency with Lynx, a Magisk module tailored for root users. Gamers c…☆17Updated this week
- TakeNote is a Markdown note taking app for macOS and iOS with helpful AI features.☆20Jun 14, 2026Updated 4 months ago
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆67Oct 3, 2024Updated 2 years ago
- Nvidia spoofer for AMD and Intel cards on Vulkan☆14Apr 1, 2024Updated 2 years ago
- NextJS Frontend + LiveKit Agent Backend to tell a voice ai agent to fill out a form and submit☆17May 16, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PrompFlower 1.0 is a command-line tool that generates AI prompts entirely locally and offline using a local AI engine via Ollama.☆12Updated this week
- A lightweight vLLM-style inference engine in Rust☆154Aug 28, 2026Updated last month
- 🤖 Native iOS implementation of the ReAct (Reasoning + Acting) AI agent pattern with SwiftUI. Watch AI think, act, and solve problems ste…☆15Jun 26, 2026Updated 3 months ago
- Native macOS MCP server that lets LLMs compose and play music☆17Nov 29, 2025Updated 10 months ago
- NewOaks AI is an AI chatbot builder, which allows you to engage with customers, nurture leads and book conversational appointments for yo…☆22Apr 3, 2024Updated 2 years ago
- Convert any Swift function to LLM ready tool with single macro☆21Sep 11, 2025Updated last year
- SmartTalk（智言）输入法是一个智能输入法项目，项目目标是通过集成先进的AI技术，将传统输入法从“工具”升级为“教练”，实现功能融合与创新，让用户秒变沟通艺术家。☆15Mar 30, 2025Updated last year