unit-mesh / edge-inferLinks
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆49Updated last year
Alternatives and similar repositories for edge-infer
Users that are interested in edge-infer are comparing it to the libraries listed below
Sorting:
- Auto Thinking Mode switch for Qwen3 in Open webui☆69Updated 6 months ago
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆34Updated 9 months ago
- Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts☆45Updated 10 months ago
- ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow☆32Updated last year
- xllamacpp - a Python wrapper of llama.cpp☆65Updated this week
- InterfaceAgent: a versatile framework designed to create system and interface agents capable of managing mobile and desktop applications …☆115Updated last year
- WIP. Apps (100+) + AI.☆30Updated last year
- 🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware☆76Updated last year
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆29Updated last year
- Rust implementation of Surya☆63Updated 8 months ago
- Opensource AI editor, All you need is editor! Studio B3 is a sophisticated editor designed for content creation, catering to various form…☆67Updated 6 months ago
- Jina DeepSearch UI☆126Updated 2 months ago
- coze api to openai☆15Updated last year
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆56Updated last year
- Turn any OCR models into online inference API endpoint 🚀 🌖☆57Updated 3 weeks ago
- CoUnit，一个基于 LLM 的虚拟团队接口人（API），通过向量化文档、知识库、SDK和 API 等，结合 LLM 智能化团队间对接与协作。Merge artificial intelligence seamlessly with team collaboration.…☆30Updated last year
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 6 months ago
- Chooat is an open-source project designed to provide a seamless and powerful AI chat experience.☆22Updated 10 months ago
- SmartVscode: Controlling anything of Vscode by natural language☆44Updated 11 months ago
- support BM25+vecetor☆29Updated 5 months ago
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆104Updated 3 months ago
- Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果☆97Updated 2 years ago
- MiniCPM on iOS.☆67Updated 8 months ago
- CursorCore: Assist Programming through Aligning Anything☆132Updated 9 months ago
- Chat with any website on your local machine☆85Updated last year
- Library for model distillation☆156Updated 2 months ago
- ☆80Updated 7 months ago
- Benchmark results from code generation with LLMs☆17Updated 2 years ago
- Enable AI to quickly retrieve content, simply!☆53Updated last year
- Conversational Retrieval Evaluation Dataset☆101Updated 3 months ago