Alternatives and similar repositories for onnxruntime-silicon

Users that are interested in onnxruntime-silicon are comparing it to the libraries listed below

• huggingface / frp
  FRP Fork
  ☆175Updated 6 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆182Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated 2 years ago
• runpod / runpod-python
  🐍 | Python library for RunPod API and serverless worker SDK.
  ☆253Updated last week
• kamalkraj / stable-diffusion-tritonserver
  Deploy stable diffusion model with onnx/tenorrt + tritonserver
  ☆127Updated 2 years ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• argmaxinc / whisperkittools
  Python tools for WhisperKit: Model conversion, optimization and evaluation
  ☆228Updated 2 months ago
• Lednik7 / CLIP-ONNX
  It is a simple library to speed up CLIP inference up to 3x (K80 GPU)
  ☆223Updated 2 years ago
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆66Updated 2 weeks ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆69Updated last week
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆538Updated last year
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆272Updated last year
• huggingface / sam2-studio
  ☆383Updated last year
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• riccardomusmeci / mlx-image
  mlx image models for Apple Silicon machines
  ☆86Updated 5 months ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆159Updated 5 months ago
• OFA-Sys / diffusion-deploy
  ☆52Updated 2 years ago
• herrera-luis / vision-core-ai
  Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.
  ☆46Updated last year
• wangchou / callCoreMLFromCppOrPython
  example of using CoreML from c++
  ☆23Updated 2 years ago
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆180Updated this week
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆190Updated last year
• runpod / runpodctl
  🧰 | RunPod CLI for pod management
  ☆336Updated 3 weeks ago
• cansik / mediapipe-silicon
  Prebuilt Google MediaPipe packages for arm64.
  ☆79Updated 2 years ago
• RobertRiachi / ANE-Optimized-Whisper-OpenAI
  ☆54Updated 2 years ago
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆522Updated 3 months ago
• argmaxinc / DiffusionKit
  On-device Image Generation for Apple Silicon
  ☆657Updated 5 months ago
• basetenlabs / truss-examples
  Examples of models deployable with Truss
  ☆205Updated this week
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆174Updated last month
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year