Alternatives and similar repositories for onnxruntime-silicon

Users that are interested in onnxruntime-silicon are comparing it to the libraries listed below

• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated last year
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆69Updated 2 weeks ago
• runpod / runpod-python
  🐍 | Python library for RunPod API and serverless worker SDK.
  ☆248Updated last week
• kamalkraj / stable-diffusion-tritonserver
  Deploy stable diffusion model with onnx/tenorrt + tritonserver
  ☆126Updated 2 years ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆182Updated last year
• RobertRiachi / ANE-Optimized-Whisper-OpenAI
  ☆55Updated 2 years ago
• argmaxinc / whisperkittools
  Python tools for WhisperKit: Model conversion, optimization and evaluation
  ☆227Updated last month
• huggingface / frp
  FRP Fork
  ☆176Updated 5 months ago
• runpod / runpodctl
  🧰 | RunPod CLI for pod management
  ☆333Updated this week
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆62Updated 2 weeks ago
• runpod / serverless-workers
  ⚙️ | REPLACED BY https://github.com/runpod-workers | Official set of serverless worker provided by RunPod as endpoints.
  ☆61Updated 3 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆159Updated 4 months ago
• PINTO0309 / whisper-onnx-cpu
  ONNX implementation of Whisper. PyTorch free.
  ☆99Updated 9 months ago
• runpod / containers
  🐳 | Dockerfiles for the RunPod container images used for our official templates.
  ☆202Updated 3 weeks ago
• louis-she / gradio-log
  A Gradio component designed to continuously show any logs.
  ☆50Updated 9 months ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆530Updated 11 months ago
• aarnphm / whispercpp
  Pybind11 bindings for Whisper.cpp
  ☆339Updated 9 months ago
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆175Updated 3 weeks ago
• cansik / mediapipe-silicon
  Prebuilt Google MediaPipe packages for arm64.
  ☆79Updated 2 years ago
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆53Updated last year
• zhuzilin / whisper-openvino
  openvino version of openai/whisper
  ☆175Updated last year
• PABannier / encodec.cpp
  Port of Meta's Encodec in C/C++
  ☆225Updated 9 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆176Updated 3 weeks ago
• bananaml / serverless-template
  ☆86Updated 2 years ago
• JosefAlbers / Phi-3-Vision-MLX
  Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon
  ☆272Updated last year
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆188Updated last year