unit-mesh / edge-infer
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆39Updated 10 months ago
Alternatives and similar repositories for edge-infer:
Users that are interested in edge-infer are comparing it to the libraries listed below
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆35Updated last week
- Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page☆25Updated last year
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆26Updated 5 months ago
- ☆26Updated 6 months ago
- A transformer-based multimodal model for music.☆28Updated 6 months ago
- WhisperMesh is an advanced chatbot that integrates voice and text interactions, delivering personalized responses through LLM models and …☆14Updated 3 weeks ago
- CoUnit，一个基于 LLM 的虚拟团队接口人（API），通过向量化文档、知识库、SDK和 API 等，结合 LLM 智能化团队间对接与协作。Merge artificial intelligence seamlessly with team collaboration.…☆29Updated 10 months ago
- Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts☆43Updated last month
- support BM25+vecetor☆26Updated 2 months ago
- 用文本编辑器剪视频☆36Updated last year
- Exploration: using technology to aid people who lack both the ability to speak and fine motor control.☆15Updated 3 months ago
- coze api to openai☆13Updated 5 months ago
- Datalore is an AI-powered Data Analysis tool that integrates Anthropic's Claude API with various data analysis libraries and custom funct…☆39Updated this week
- ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow☆27Updated 5 months ago
- CursorCore: Assist Programming through Aligning Anything☆110Updated last week
- Open-source observability for your LLM application.☆48Updated last month
- Opensource AI editor, All you need is editor! Studio B3 is a sophisticated editor designed for content creation, catering to various form…☆61Updated 3 months ago
- Conversational Retrieval Evaluation Dataset☆98Updated last week
- Evaluation for AI apps and agent☆36Updated last year
- Unit Minions 的各种数据准备、处理脚本，诸如 OpenAI 处理、格式转换等等。☆14Updated last year
- Luann allows you to create a LLM agent,which has complete memory module (long-term memory, short-term memory) and knowledge module（Variou…☆18Updated last week
- YC companies example built on Trieve☆14Updated 6 months ago
- MiniCPM on iOS.☆65Updated 8 months ago
- AGI模块库架构图☆75Updated last year
- 视频理解：千问视频多模态模型 & Dify☆32Updated 5 months ago
- GPT+神器，简单实用的一站式AGI架构，内置本地化，LLM模型，agent，矢量数据库，智能链chain☆48Updated last year
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆36Updated 9 months ago
- Prompt 工程师利器，可同时比较多个 Prompts 在多个 LLM 模型上的效果☆95Updated last year