second-state / WasmEdge-WASINN-examples

Related projects ⓘ

Alternatives and complementary repositories for WasmEdge-WASINN-examples

• WebAssembly / wasi-nn
  Neural Network proposal for WASI
  ☆471Updated 3 weeks ago
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,096Updated this week
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆215Updated last year
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆124Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆625Updated this week
• codestoryai / sidecar
  Sidecar is the AI brains for the Aide editor and works alongside it, locally on your machine
  ☆130Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
  ☆441Updated 3 weeks ago
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated 10 months ago
• WasmEdge / mediapipe-rs
  The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…
  ☆157Updated last month
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆279Updated last year
• crabml / crabml
  a fast cross platform AI inference engine 🤖 using Rust 🦀 and WebGPU 🎮
  ☆403Updated last month
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆214Updated 3 months ago
• gaxler / llama2.rs
  Inference Llama 2 in one file of pure Rust 🦀
  ☆229Updated last year
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆265Updated last month
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆927Updated 3 weeks ago
• santiagomed / orca
  LLM Orchestrator built in Rust
  ☆267Updated 8 months ago
• asg017 / sqlite-lembed
  A SQLite extension for generate text embeddings from GGUF models using llama.cpp
  ☆131Updated last month
• fennel-ai / fann
  Approx nearest neighbor search in Rust
  ☆162Updated last year
• vmware-labs / webassembly-language-runtimes
  Wasm Language Runtimes provides popular language runtimes (Ruby, Python, …) precompiled to WebAssembly that are tested for compatibility …
  ☆337Updated 5 months ago
• WasmEdge / wasmedge-db-examples
  Lightweight database clients in the WasmEdge Runtime
  ☆66Updated 3 months ago
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆240Updated last week
• LlamaEdge / rag-api-server
  A RAG API server written in Rust following OpenAI specs
  ☆31Updated last week
• ToluClassics / candle-tutorial
  Tutorial for Porting PyTorch Transformer Models to Candle (Rust)
  ☆252Updated 3 months ago
• asg017 / sqlite-rembed
  A SQLite extension for generating text embeddings from remote APIs (OpenAI, Nomic, Ollama, llamafile...)
  ☆86Updated 2 weeks ago
• Vaibhavs10 / fast-llm.rs
  ☆136Updated 9 months ago
• jimexist / surya-rs
  Rust implementation of Surya
  ☆52Updated last month
• second-state / dapr-wasm
  A template project to demonstrate how to run WebAssembly functions as sidecar microservices in dapr
  ☆277Updated 11 months ago
• mdrokz / rust-llama.cpp
  LLama.cpp rust bindings
  ☆339Updated 4 months ago
• jondot / awesome-rust-llm
  🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI
  ☆287Updated 8 months ago
• bitswired / rustgpt
  RustGPT is a ChatGPT UI built with Rust + HTMX: the power of Rust coupled with the simplicity of HTMX 💚
  ☆664Updated 11 months ago