Alternatives and similar repositories for onnxruntime-silicon

Users that are interested in onnxruntime-silicon are comparing it to the libraries listed below

• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆183Updated 2 years ago
• RobertRiachi / ANE-Optimized-Whisper-OpenAI
  ☆58Updated 2 years ago
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated 2 years ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆569Updated last year
• herrera-luis / vision-core-ai
  Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.
  ☆46Updated 2 years ago
• runpod / runpod-python
  🐍 | Python library for RunPod API and serverless worker SDK.
  ☆259Updated last week
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆87Updated 2 weeks ago
• huggingface / frp
  FRP Fork
  ☆177Updated 8 months ago
• argmaxinc / whisperkittools
  Python tools for WhisperKit: Model conversion, optimization and evaluation
  ☆232Updated last month
• runpod / serverless-workers
  ⚙️ | REPLACED BY https://github.com/runpod-workers | Official set of serverless worker provided by RunPod as endpoints.
  ☆61Updated 6 months ago
• PABannier / encodec.cpp
  Port of Meta's Encodec in C/C++
  ☆227Updated last year
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆54Updated last year
• basetenlabs / truss-examples
  Examples of models deployable with Truss
  ☆211Updated last week
• argmaxinc / DiffusionKit
  On-device Image Generation for Apple Silicon
  ☆677Updated 8 months ago
• runpod / runpodctl
  🧰 | Runpod CLI for pod management
  ☆352Updated last week
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆544Updated 6 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆166Updated 8 months ago
• aarnphm / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆342Updated last year
• j-csc / mlx_bark
  Port of Suno's Bark TTS transformer in Apple's MLX Framework
  ☆86Updated last year
• Lednik7 / CLIP-ONNX
  It is a simple library to speed up CLIP inference up to 3x (K80 GPU)
  ☆229Updated 2 years ago
• runpod / containers
  🐳 | Dockerfiles for the RunPod container images used for our official templates.
  ☆215Updated last week
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆275Updated last month
• stlukey / whispercpp.py
  Python bindings for whisper.cpp
  ☆247Updated last year
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• riccardomusmeci / mlx-image
  mlx image models for Apple Silicon machines
  ☆88Updated 3 weeks ago
• zhuzilin / whisper-openvino
  openvino version of openai/whisper
  ☆178Updated 2 years ago
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆76Updated 2 years ago
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆178Updated 2 weeks ago
• louis-she / gradio-log
  A Gradio component designed to continuously show any logs.
  ☆54Updated last year