Alternatives and similar repositories for WasmEdge-WASINN-examples:

Users that are interested in WasmEdge-WASINN-examples are comparing it to the libraries listed below

• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,260Updated this week
• WebAssembly / wasi-nn
  Neural Network proposal for WASI
  ☆490Updated 4 months ago
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆215Updated last year
• WasmEdge / mediapipe-rs
  The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…
  ☆172Updated 5 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆666Updated 3 months ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆140Updated last year
• moxin-org / moly
  Moly: an AI LLM GUI app in pure Rust
  ☆202Updated this week
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆320Updated this week
• santiagomed / orca
  LLM Orchestrator built in Rust
  ☆272Updated 11 months ago
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,707Updated 7 months ago
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆278Updated last year
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆183Updated 2 weeks ago
• mdrokz / rust-llama.cpp
  LLama.cpp rust bindings
  ☆374Updated 8 months ago
• VivekPanyam / carton
  Run any ML model from any programming language.
  ☆422Updated last year
• crabml / crabml
  a fast cross platform AI inference engine 🤖 using Rust 🦀 and WebGPU 🎮
  ☆432Updated 2 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆604Updated this week
• LlamaEdge / rag-api-server
  A RAG API server written in Rust following OpenAI specs
  ☆44Updated last week
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated last year
• second-state / dapr-wasm
  A template project to demonstrate how to run WebAssembly functions as sidecar microservices in dapr
  ☆279Updated last year
• gaxler / llama2.rs
  Inference Llama 2 in one file of pure Rust 🦀
  ☆232Updated last year
• fiddlecube / fiddlecube-sdk
  Generate ideal question-answers for testing RAG
  ☆126Updated last week
• utilityai / llama-cpp-rs
  ☆224Updated this week
• dmarcos / llama2.c-web
  Simple repo that compiles and runs llama2.c on the Web
  ☆54Updated last year
• Vaibhavs10 / fast-llm.rs
  ☆135Updated last year
• guywaldman / orch
  Rust framework for LLM orchestration
  ☆202Updated 7 months ago
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆288Updated this week
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆208Updated 9 months ago
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆975Updated 4 months ago
• Noeda / rllama
  Rust+OpenCL+AVX2 implementation of LLaMA inference code
  ☆542Updated last year