unit-mesh / edge-infer
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆42Updated 11 months ago
Alternatives and similar repositories for edge-infer:
Users that are interested in edge-infer are comparing it to the libraries listed below
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆35Updated last month
- WhisperMesh is an advanced chatbot that integrates voice and text interactions, delivering personalized responses through LLM models and …☆14Updated 2 months ago
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆27Updated 6 months ago
- Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page☆25Updated last year
- ☆26Updated 7 months ago
- Various LLM Benchmarks☆14Updated last week
- ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow☆30Updated 7 months ago
- Jina DeepSearch UI☆85Updated this week
- A transformer-based multimodal model for music.☆28Updated 7 months ago
- Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts☆43Updated 2 months ago
- support BM25+vecetor☆26Updated 4 months ago
- MiniCPM on iOS.☆67Updated 2 weeks ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆68Updated 8 months ago
- SmartVscode: Controlling anything of Vscode by natural language☆42Updated 4 months ago
- LLM-as-SERP☆59Updated 3 weeks ago
- Exploration: using technology to aid people who lack both the ability to speak and fine motor control.☆20Updated 5 months ago
- ☆51Updated last month
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆91Updated 2 months ago
- A tiny 1000 line implementation of GraphRAG in Python☆57Updated last month
- coze api to openai☆13Updated 7 months ago
- An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.☆33Updated this week
- ☆73Updated last month
- InterfaceAgent: a versatile framework designed to create system and interface agents capable of managing mobile and desktop applications …☆112Updated 11 months ago
- Datalore is an AI-powered Data Analysis tool that integrates Anthropic's Claude API with various data analysis libraries and custom funct…☆40Updated last month
- Rust implementation of Surya☆57Updated last month
- AI Frontiers Digest leverages LLMs to intelligently curate and summarize the latest developments in AI, while also generating engaging Po…☆30Updated last month
- An LLM-based agent simulation framework that simulates human behavior and generates dynamic, text-based social graphs.☆67Updated this week
- Opensource AI editor, All you need is editor! Studio B3 is a sophisticated editor designed for content creation, catering to various form…☆63Updated 4 months ago
- GPT+神器，简单实用的一站式AGI架构，内置本地化，LLM模型，agent，矢量数据库，智能链chain☆48Updated last year
- Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…☆31Updated last week