second-state / WasmEdge-WASINN-examples

Related projects: ⓘ

• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆567Updated last week
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆212Updated 11 months ago
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆990Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling in-browser LLM inference
  ☆342Updated 2 weeks ago
• WasmEdge / mediapipe-rs
  The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…
  ☆141Updated last month
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆229Updated 3 weeks ago
• crabml / crabml
  a fast cross platform AI inference engine 🤖 using Rust 🦀 and WebGPU 🎮
  ☆394Updated last month
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆113Updated 10 months ago
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,605Updated last month
• VivekPanyam / carton
  Run any ML model from any programming language.
  ☆421Updated 8 months ago
• Vaibhavs10 / fast-llm.rs
  ☆134Updated 7 months ago
• fennel-ai / fann
  Approx nearest neighbor search in Rust
  ☆160Updated last year
• jondot / awesome-rust-llm
  🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI
  ☆236Updated 6 months ago
• santiagomed / orca
  LLM Orchestrator built in Rust
  ☆261Updated 6 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• mdrokz / rust-llama.cpp
  LLama.cpp rust bindings
  ☆320Updated 2 months ago
• shafishlabs / llmchain-rs
  🦀Rust + Large Language Models - Make AI Services Freely and Easily.
  ☆180Updated 6 months ago
• gaxler / llama2.rs
  Inference Llama 2 in one file of pure Rust 🦀
  ☆227Updated last year
• not-pizza / victor
  Web-optimized vector database (written in Rust).
  ☆186Updated 2 months ago
• ToluClassics / candle-tutorial
  Tutorial for Porting PyTorch Transformer Models to Candle (Rust)
  ☆235Updated last month
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆278Updated last year
• oasysai / oasysdb
  Hybrid vector database with flexible SQL storage engine & multi-index support.
  ☆343Updated this week
• utilityai / llama-cpp-rs
  ☆134Updated this week
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆330Updated 2 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆145Updated last year
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,005Updated 9 months ago
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆161Updated 3 months ago
• Vaibhavs10 / hf-llm.rs
  ☆190Updated last week
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆227Updated last month
• bosun-ai / swiftide
  Fast, streaming indexing and query library for AI (RAG) applications, written in Rust
  ☆129Updated this week