unit-mesh / edge-infer
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型(包括向量化和 Onnx 模型),如 Android、iOS 或 MCUs,实现高效的边缘智能,用于实时决策。
☆44Updated last year
Alternatives and similar repositories for edge-infer
Users that are interested in edge-infer are comparing it to the libraries listed below
Sorting:
- Auto Thinking Mode switch for Qwen3 in Open webui☆60Updated last week
- WhisperMesh is an advanced chatbot that integrates voice and text interactions, delivering personalized responses through LLM models and …☆14Updated 3 weeks ago
- Various LLM Benchmarks☆19Updated last week
- Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…☆35Updated 3 months ago
- Chrome extension to add a link from each Arxiv page to the corresponding HF Paper page☆26Updated last year
- Exploration: using technology to aid people who lack both the ability to speak and fine motor control.☆20Updated 6 months ago
- A Next.js version of Claude Aritfacts , inspired by llamacoder☆22Updated 7 months ago
- 👷♂️Minion is Agent's Brain. Minion is designed to execute any type of queries, offering a variety of features that demonstrate its flex…☆14Updated 2 weeks ago
- An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.☆27Updated 7 months ago
- Jina DeepSearch UI☆106Updated this week
- support BM25+vecetor☆28Updated 5 months ago
- An AI regulatory assistant to pre-check your documentation before FDA or MDR submission.☆11Updated 9 months ago
- ☆20Updated last year
- A transformer-based multimodal model for music.☆28Updated 9 months ago
- InterfaceAgent: a versatile framework designed to create system and interface agents capable of managing mobile and desktop applications …☆112Updated last year
- YC companies example built on Trieve☆14Updated 9 months ago
- ☆77Updated last month
- An abstraction library for building domain-specific intelligent agents based on Large Language Models (LLMs). LLMAgent provides a core ar…☆25Updated last month
- ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow☆31Updated 8 months ago
- MiniCPM on iOS.☆68Updated last month
- A voice assistant that runs completely on your local device.☆18Updated last week
- A tiny 1000 line implementation of GraphRAG in Python☆69Updated 2 months ago
- Very minimal (and stateless) agent framework☆43Updated 4 months ago
- LLM-as-SERP☆65Updated 2 months ago
- The minimal, ad-hoc way of plug and play NebulaGraph with pip install, even inside Colab Notebook!☆17Updated 11 months ago
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆21Updated 9 months ago
- xllamacpp - a Python wrapper of llama.cpp☆36Updated this week
- Open source health metric tracking.☆34Updated 5 months ago
- ☆101Updated 8 months ago
- Chat with any website on your local machine☆74Updated 10 months ago