unit-mesh / edge-infer
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆39Updated 9 months ago
Alternatives and similar repositories for edge-infer:
Users that are interested in edge-infer are comparing it to the libraries listed below
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆34Updated last month
- Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page☆25Updated last year
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆26Updated 3 months ago
- CursorCore: Assist Programming through Aligning Anything☆79Updated 3 months ago
- WhisperMesh is an advanced chatbot that integrates voice and text interactions, delivering personalized responses through LLM models and …☆13Updated 2 months ago
- Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts☆43Updated this week
- support BM25+vecetor☆26Updated last month
- Luann allows you to create a LLM agent,which has complete memory module (long-term memory, short-term memory) and knowledge module（Variou…☆16Updated 2 weeks ago
- A transformer-based multimodal model for music.☆29Updated 5 months ago
- GPT+神器，简单实用的一站式AGI架构，内置本地化，LLM模型，agent，矢量数据库，智能链chain☆48Updated last year
- coze api to openai☆13Updated 4 months ago
- g1: Using GPT-4o to create o1-like reasoning chains☆20Updated 4 months ago
- Conversational Retrieval Evaluation Dataset☆93Updated 3 months ago
- Empowering everyone to create reliable and safety AI coding agent.☆12Updated 4 months ago
- A Next.js version of Claude Aritfacts , inspired by llamacoder☆18Updated 3 months ago
- Opensource AI editor, All you need is editor! Studio B3 is a sophisticated editor designed for content creation, catering to various form…☆57Updated 2 months ago
- Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model☆20Updated 3 months ago
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆36Updated 8 months ago
- ☆26Updated 4 months ago
- 用文本编辑器剪视频☆36Updated last year
- Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai☆49Updated 2 months ago
- Evaluation for AI apps and agent☆36Updated last year
- MiniCPM on iOS.☆62Updated 7 months ago
- Real time faster whisper gradio☆26Updated 3 months ago
- 如需体验textin文档解析，请点击https://cc.co/16YSIy☆23Updated 6 months ago
- FlexRAG: A RAG Framework for Information Retrieval and Generation.☆103Updated this week
- 1000个创业Idea，来自ycombinator，一行一个创业思路;1000 entrepreneurial ideas from ycombinator, one entrepreneurial idea per line.☆38Updated last month
- Open-source observability for your LLM application.☆47Updated 2 weeks ago
- A simple AI Agent Framework using table software like Excel/Google Sheets as GUI☆15Updated 6 months ago