unit-mesh / edge-inferLinks
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆46Updated last year
Alternatives and similar repositories for edge-infer
Users that are interested in edge-infer are comparing it to the libraries listed below
Sorting:
- Auto Thinking Mode switch for Qwen3 in Open webui☆67Updated 3 months ago
- 🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware☆77Updated last year
- GPT+神器，简单实用的一站式AGI架构，内置本地化，LLM模型，agent，矢量数据库，智能链chain☆48Updated 2 years ago
- ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow☆32Updated 11 months ago
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆35Updated 5 months ago
- WIP. Apps (100+) + AI.☆30Updated 11 months ago
- Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.☆53Updated last year
- An open-source framework for building monolithic or distributed agentic systems, ranging from simple LLM calls to compositional workflows…☆21Updated last week
- Enable tool-use ability for any LLM model (DeepSeek V3/R1, etc.)☆53Updated 2 months ago
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆104Updated last week
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆28Updated 10 months ago
- AGI模块库架构图☆76Updated last year
- Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果☆95Updated 2 years ago
- Opensource AI editor, All you need is editor! Studio B3 is a sophisticated editor designed for content creation, catering to various form…☆66Updated 2 months ago
- Conversational Retrieval Evaluation Dataset☆101Updated 5 months ago
- Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page☆27Updated last year
- HayLM是专门为儿童训练的大模型，通过对InternLM的训练和微调，结合儿童心理学、教育学以及对话风格的数据训练，实现与儿童的智能互动，并在交流过程中不断学习和适应用户特性，成为一个伴随儿童成长的虚拟朋友。☆16Updated 6 months ago
- OVALChat is a customizable Web app aimed at conducting user studies with chatbots☆28Updated last year
- Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts☆45Updated 6 months ago
- agentcraft 可以帮助您快速构建各类应用场景的ai agent应用☆74Updated this week
- InterfaceAgent: a versatile framework designed to create system and interface agents capable of managing mobile and desktop applications …☆114Updated last year
- Datalore is an AI-powered Data Analysis tool that integrates Anthropic's Claude API with various data analysis libraries and custom funct…☆40Updated 5 months ago
- MiniCPM on iOS.☆68Updated 4 months ago
- Turn any OCR models into online inference API endpoint 🚀 🌖☆57Updated 4 months ago
- A transformer-based multimodal model for music.☆29Updated 11 months ago
- SmartVscode: Controlling anything of Vscode by natural language☆45Updated 8 months ago
- support BM25+vecetor☆29Updated 2 months ago
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 3 months ago
- Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai☆75Updated 9 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆53Updated this week