Alternatives and similar repositories for edge-infer

Users that are interested in edge-infer are comparing it to the libraries listed below

• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆70Updated 9 months ago
• LB-Young / Bambo
  Bambo is a new proxy framework. Compared with mainstream frameworks, it is more lightweight and flexible and can handle various load task…
  ☆33Updated last year
• francedot / Interface-Agent
  InterfaceAgent: a versatile framework designed to create system and interface agents capable of managing mobile and desktop applications …
  ☆115Updated last year
• linexjlin / realtime_transcription
  ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow
  ☆32Updated last year
• jimexist / surya-rs
  Rust implementation of Surya
  ☆65Updated 11 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆73Updated this week
• Muhtasham / pod-helper
  🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware
  ☆77Updated last year
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆108Updated 6 months ago
• zhangzhejian / codeinterpreter-codebox
  Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.
  ☆58Updated last year
• appl-team / reppl
  Using APPL to reimplement popular algorithms for Large Language Models (LLMs) and prompts
  ☆45Updated last year
• notedit / coze2openai
  coze api to openai
  ☆15Updated last year
• dubeno / NotebookLLM-Chinese
  Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai
  ☆83Updated last year
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆161Updated 5 months ago
• jina-ai / deepsearch-ui
  Jina DeepSearch UI
  ☆127Updated 5 months ago
• AgentEra / Agently-Talk-to-Control
  An open-source chat text to control actions agentic workflow framework/showcase powered by Agently AI application development framework.
  ☆29Updated last year
• TechxGenus / CursorCore
  CursorCore: Assist Programming through Aligning Anything
  ☆133Updated 11 months ago
• soulteary / 100-apps-plus-AI
  WIP. Apps (100+) + AI.
  ☆31Updated last year
• MuiscNN / Lamucal
  A transformer-based multimodal model for music.
  ☆29Updated last year
• stanford-oval / ovalchat
  OVALChat is a customizable Web app aimed at conducting user studies with chatbots
  ☆29Updated 2 years ago
• jina-ai / node-serp
  LLM-as-SERP
  ☆68Updated 11 months ago
• cpldcpu / llmbenchmark
  Various LLM Benchmarks
  ☆24Updated 3 months ago
• ericciarla / local-website-chatbot
  Chat with any website on your local machine
  ☆85Updated last year
• etrobot / nextArtifacts
  A Next.js version of Claude Aritfacts , inspired by llamacoder
  ☆27Updated last year
• lewangdev / CosyVoice
  Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
  ☆13Updated last year
• Vaibhavs10 / llama-assistant
  ☆170Updated last year
• PirateforFreedom / luann
  Luann (fka TypeAgent) allows you to create many LLM based agent(Various types of agent,scale up)
  ☆24Updated 2 months ago
• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆43Updated last year
• sparticleinc / ASEED
  Conversational Retrieval Evaluation Dataset
  ☆101Updated 5 months ago
• micic-mihajlo / Datalore
  Datalore is an AI-powered Data Analysis tool that integrates Anthropic's Claude API with various data analysis libraries and custom funct…
  ☆42Updated 11 months ago
• candytools-ai / chooat-chat-ai
  Chooat is an open-source project designed to provide a seamless and powerful AI chat experience.
  ☆21Updated last year