unit-mesh / edge-inferLinks
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆45Updated last year
Alternatives and similar repositories for edge-infer
Users that are interested in edge-infer are comparing it to the libraries listed below
Sorting:
- Auto Thinking Mode switch for Qwen3 in Open webui☆65Updated last month
- WhisperMesh is an advanced chatbot that integrates voice and text interactions, delivering personalized responses through LLM models and …☆14Updated 2 months ago
- Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page☆27Updated last year
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆35Updated 4 months ago
- A transformer-based multimodal model for music.☆28Updated 10 months ago
- ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow☆31Updated 9 months ago
- A voice assistant that runs completely on your local device.☆19Updated last week
- xllamacpp - a Python wrapper of llama.cpp☆44Updated last week
- Try out HallOumi, a state-of-the-art claim verification model in a simple UI!☆35Updated 2 months ago
- ☆26Updated 10 months ago
- support BM25+vecetor☆29Updated last month
- Rust implementation of Surya☆58Updated 3 months ago
- Exploration: using technology to aid people who lack both the ability to speak and fine motor control.☆21Updated 8 months ago
- Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts☆45Updated 5 months ago
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆28Updated 9 months ago
- Various LLM Benchmarks☆21Updated 3 weeks ago
- MiniCPM on iOS.☆68Updated 3 months ago
- Conversational Retrieval Evaluation Dataset☆100Updated 3 months ago
- ☆25Updated 4 months ago
- Enable tool-use ability for any LLM model (DeepSeek V3/R1, etc.)☆51Updated 3 weeks ago
- Awesome Code Action - DeepWebSearch AgentKit App. Build with 🤗 Hugging Face smolagents framework☆72Updated last week
- InterfaceAgent: a versatile framework designed to create system and interface agents capable of managing mobile and desktop applications …☆112Updated last year
- An abstraction library for building domain-specific intelligent agents based on Large Language Models (LLMs). LLMAgent provides a core ar…☆27Updated 2 months ago
- ☆101Updated 9 months ago
- CoUnit，一个基于 LLM 的虚拟团队接口人（API），通过向量化文档、知识库、SDK和 API 等，结合 LLM 智能化团队间对接与协作。Merge artificial intelligence seamlessly with team collaboration.…☆30Updated last year
- Simple script to quickly implement DDNS based on CloudFlare.☆16Updated 2 months ago
- coze api to openai☆14Updated 9 months ago
- 👷♂️Minion is Agent's Brain. Minion is designed to execute any type of queries, offering a variety of features that demonstrate its flex…☆22Updated 2 weeks ago
- Opensource AI editor, All you need is editor! Studio B3 is a sophisticated editor designed for content creation, catering to various form…☆66Updated last month
- Qwen LLM in the mac menu bar <3☆25Updated 3 months ago