Alternatives and similar repositories for ollama

Users that are interested in ollama are comparing it to the libraries listed below

• modelscope / modelscope-studio
  A third-party component library based on Gradio.
  ☆108Updated last week
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆134Updated last week
• tc-mb / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆97Updated this week
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆66Updated 2 months ago
• zRzRzRzRzRzRzR / GLM-4
  GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型
  ☆26Updated last month
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆44Updated last week
• dubeno / NotebookLLM-Chinese
  Cross Platform Open Sourced Chinese NoteBookLM app based on Electron, Use DeepSeek + Reecho.ai
  ☆74Updated 8 months ago
• zkh2016 / LLMFarm
  MiniCPM on iOS.
  ☆68Updated 3 months ago
• fyabc / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆40Updated last month
• camenduru / Qwen-VL-Chat-colab
  ☆82Updated last year
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆233Updated this week
• HimariO / llama.cpp.qwen2.5vl
  Port of Facebook's LLaMA model in C/C++
  ☆53Updated 2 months ago
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆144Updated last month
• mehdihosseinimoghadam / open-sourced-nootbookLM
  Open Sourced NoteBookLM
  ☆59Updated 9 months ago
• zhangzhejian / codeinterpreter-codebox
  Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.
  ☆53Updated last year
• ziwang-com / mini-AGI
  GPT+神器，简单实用的一站式AGI架构，内置本地化，LLM模型，agent，矢量数据库，智能链chain
  ☆48Updated 2 years ago
• etrobot / nextArtifacts
  A Next.js version of Claude Aritfacts , inspired by llamacoder
  ☆23Updated 9 months ago
• linexjlin / realtime_transcription
  ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow
  ☆31Updated 10 months ago
• Muhtasham / pod-helper
  🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware
  ☆77Updated last year
• wade1010 / graphrag-ui
  The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation
  ☆154Updated 9 months ago
• NVIDIA / workbench-llamafactory
  This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
  ☆61Updated 8 months ago
• ai-bot-pro / achatbot
  An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.
  ☆59Updated this week
• jina-ai / deepsearch-ui
  Jina DeepSearch UI
  ☆117Updated 2 weeks ago
• eosphoros-ai / DB-GPT-Plugins
  Multi-Agents & Plugins repo for DB-GPT, Can complete various tasks around databases.
  ☆103Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆185Updated last week
• shareAI-lab / oManus
  A open version Manus.
  ☆59Updated 3 months ago
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆74Updated last year
• 1694439208 / GOT-OCR-Inference
  研究GOT-OCR-项目落地加速，不限语言
  ☆60Updated 8 months ago
• limafang / Xtuner-GUI
  Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…
  ☆13Updated last year
• crazywoola / dify-tools-worker
  A function calling tool can be deployed to Cloudflare Workers with openapi schema
  ☆97Updated last year