unit-mesh / edge-infer
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型(包括向量化和 Onnx 模型),如 Android、iOS 或 MCUs,实现高效的边缘智能,用于实时决策。
☆36Updated 5 months ago
Related projects: ⓘ
- A transformer-based multimodal model for music.☆27Updated last month
- ☆25Updated last month
- Shire - AI Coding Agent Language (编程智能体语言), which can enables communication between an LLM and control IDE for automated programming.☆116Updated this week
- Rust implementation of Surya☆46Updated last month
- Conversational Retrieval Evaluation Dataset☆86Updated 2 months ago
- coze api to openai☆11Updated 2 weeks ago
- MacOS Agent: A Simplified Assistant for Your Mac☆47Updated last month
- 用文本编辑器剪视频☆36Updated last year
- A lightweight end-to-end text-to-speech model☆79Updated this week
- ⚡️ 80x faster language detection with Fasttext | Split text by language for TTS☆104Updated last week
- GPT+神器,简单实用的一站式AGI架构,内置本地化,LLM模型,agent,矢量数据库,智能链chain☆47Updated last year
- XVERSE-MoE-A4.2B: A multilingual large language model developed by XVERSE Technology Inc.☆35Updated 4 months ago
- MoonPalace(月宫)是由 Moonshot AI 月之暗面提供的 API 调试工具。☆54Updated last week
- A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.☆68Updated 2 months ago
- Discover and converse with advanced AI models like Mistral, LLAMA2, and GPT-3.5 from leading sources like OLLAMA, Hugging Face, and OpenA…☆37Updated last week
- Opensource AI editor, All you need is editor! Studio B3 is a sophisticated editor designed for content creation, catering to various form…☆51Updated 7 months ago
- CoUnit,一个基于 LLM 的虚拟团队接口人(API),通过向量化文档、知识库、SDK和 API 等,结合 LLM 智能化团队间对接与协作。Merge artificial intelligence seamlessly with team collaboration.…☆27Updated 5 months ago
- ☆35Updated last month
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆23Updated 2 months ago
- A lightweight script for processing HTML page to markdown format with support for code blocks☆70Updated 5 months ago
- Unit Minions 的各种数据准备、处理脚本,诸如 OpenAI 处理、格式转换等等。☆14Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆53Updated 2 months ago
- ☆14Updated 4 months ago
- Prompt 工程师利器,可同时比较多个 Prompts 在多个 LLM 模型上的效果☆95Updated last year
- Evaluation for AI apps and agent☆35Updated 8 months ago
- We Speech Transcript based on LLM, in 300 lines of code.☆117Updated last month
- ☆36Updated last week
- 🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware☆78Updated 6 months ago
- g1: Using GPT-4o to create o1-like reasoning chains☆15Updated this week
- Its an open source LLM based on MOE Structure.☆56Updated 2 months ago