unit-mesh / edge-infer
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆44Updated last year
Alternatives and similar repositories for edge-infer:
Users that are interested in edge-infer are comparing it to the libraries listed below
- WhisperMesh is an advanced chatbot that integrates voice and text interactions, delivering personalized responses through LLM models and …☆14Updated this week
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆35Updated 2 months ago
- Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page☆25Updated last year
- Exploration: using technology to aid people who lack both the ability to speak and fine motor control.☆20Updated 6 months ago
- ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow☆30Updated 7 months ago
- Try out HallOumi, a state-of-the-art claim verification model in a simple UI!☆30Updated 3 weeks ago
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆27Updated 7 months ago
- Jina DeepSearch UI☆97Updated last week
- ☆26Updated 8 months ago
- Various LLM Benchmarks☆19Updated 2 weeks ago
- A transformer-based multimodal model for music.☆28Updated 8 months ago
- GPT+神器，简单实用的一站式AGI架构，内置本地化，LLM模型，agent，矢量数据库，智能链chain☆48Updated last year
- xllamacpp - a Python wrapper of llama.cpp☆35Updated last week
- A Next.js version of Claude Aritfacts , inspired by llamacoder☆22Updated 7 months ago
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆25Updated last week
- OVALChat is a customizable Web app aimed at conducting user studies with chatbots☆28Updated last year
- AI tool that annotates research papers and shows related articles and videos for better understanding☆40Updated last month
- Luann allows you to create a LLM agent,which has complete memory module (long-term memory, short-term memory) and knowledge module（Variou…☆21Updated last month
- 用文本编辑器剪视频☆37Updated last year
- GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型☆24Updated last week
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆21Updated 8 months ago
- coze api to openai☆14Updated 7 months ago
- A tiny 1000 line implementation of GraphRAG in Python☆67Updated last month
- Discover advanced AI techniques in my repository combining Multi-Hop Chain of Thought (CoT) and Retrieval-Augmented Generation (RAG) usin…☆13Updated 8 months ago
- g1: Using GPT-4o to create o1-like reasoning chains☆20Updated 7 months ago
- HayLM是专门为儿童训练的大模型，通过对InternLM的训练和微调，结合儿童心理学、教育学以及对话风格的数据训练，实现与儿童的智能互动，并在交流过程中不断学习和适应用户特性，成为一个伴随儿童成长的虚拟朋友。☆10Updated 2 months ago
- Rust implementation of Surya☆58Updated last month
- ☆100Updated 7 months ago
- Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai☆71Updated 5 months ago
- Chooat is an open-source project designed to provide a seamless and powerful AI chat experience.☆20Updated 3 months ago