EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
☆51Apr 17, 2024Updated 2 years ago
Alternatives and similar repositories for edge-infer
Users that are interested in edge-infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Port of Helix MP3 code to ESP8266☆14Dec 8, 2017Updated 8 years ago
- CoUnit，一个基于 LLM 的虚拟团队接口人（API），通过向量化文档、知识库、SDK和 API 等，结合 LLM 智能化团队间对接与协作。Merge artificial intelligence seamlessly with team collaboration.…☆30Mar 29, 2024Updated 2 years ago
- ChocoBuilder (Chocolate Factory) is a cutting-edge LLM toolkit designed to empower you in creating your very own AI assistant.Chocolate F…☆222Jul 24, 2024Updated last year
- An excel-like spreadsheet component for SQLPage☆16Aug 4, 2025Updated 9 months ago
- Portable LLM - A rust library for LLM inference☆11Apr 13, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆15Jul 22, 2024Updated last year
- JAX bindings for the flash-attention3 kernels☆22Jan 2, 2026Updated 4 months ago
- 基于 CUDA Driver API 的 cuda 运行时环境☆16Jul 30, 2025Updated 9 months ago
- segment anything（SAM） for CPP Inference☆31Jun 11, 2024Updated last year
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆49Nov 12, 2024Updated last year
- A Triton JIT runtime and ffi provider in C++☆33Apr 28, 2026Updated last week
- source code for roleplaygateway.com☆10Aug 17, 2023Updated 2 years ago
- Shire Lang Spring/Java Demo project☆18Jan 14, 2025Updated last year
- Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model☆23Sep 26, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Interface Driven Distributed Data Service☆28Jan 17, 2025Updated last year
- 🤖 AI-Powered Chinese Stock Market Analysis. 一个基于 AI 的 A 股智能分析系统，提供技术分析、交易信 号和智能投资建议。内置 OpenClaw 内核，Agent 编排与记忆采用本地优先、分层记忆与心跳总结，支持单股分析、消息与…☆36Updated this week
- ☆28Jun 27, 2023Updated 2 years ago
- RWKV models and examples powered by candle.☆24Jan 19, 2026Updated 3 months ago
- Efficient inference of large language models.☆150Sep 28, 2025Updated 7 months ago
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆64Oct 3, 2024Updated last year
- MQTT broker☆11Apr 2, 2026Updated last month
- TradeGPT is a full-stack cryptocurrency trading application that combines a modern Fresh (Deno) frontend with a Python (FastAPI) backend …☆15Mar 1, 2025Updated last year
- 脸萌网页版☆13Jan 11, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- GPT-based language channel for NARS (ONA)☆40Jan 22, 2025Updated last year
- Adds a place to store your notes. Supports rich text formatting.☆27Apr 24, 2026Updated last week
- Unofficial pycurl repository with full developing history☆16Aug 9, 2013Updated 12 years ago
- Official content repository.☆33Apr 25, 2026Updated last week
- Run TFLITE models on the web☆13Jan 2, 2022Updated 4 years ago
- more lightweight remote calling Python on jupyter.☆10Dec 2, 2022Updated 3 years ago
- A model serving framework for various research and production scenarios. Seamlessly built upon the PyTorch and HuggingFace ecosystem.☆23Oct 11, 2024Updated last year
- ✨ If Posthog built Zapier. Feature complete, Fullstack, AI Automation framework made for users.☆312Aug 22, 2025Updated 8 months ago
- 📖 Webduino example collections☆10Sep 17, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- python-v4l2 fork☆14Sep 20, 2021Updated 4 years ago
- USB accessory with pyusb☆15Mar 31, 2014Updated 12 years ago
- ☆12Aug 29, 2025Updated 8 months ago
- An isomorphic Javascript client for Supabase.☆10Oct 24, 2022Updated 3 years ago
- Docs for all things Agno <v2.0.0☆48Sep 28, 2025Updated 7 months ago
- This is a python port of an excellent C Template Library 1.0 by Stephen C. Losen (http://libctemplate.sourceforge.net). Distrubuted under…☆12Feb 2, 2015Updated 11 years ago
- Chess AI and commentary powered by ChatGPT☆12Apr 26, 2023Updated 3 years ago