second-state / WasmEdge-WASINN-examplesLinks
☆253Updated 3 weeks ago
Alternatives and similar repositories for WasmEdge-WASINN-examples
Users that are interested in WasmEdge-WASINN-examples are comparing it to the libraries listed below
Sorting:
- Neural Network proposal for WASI☆515Updated 8 months ago
- OpenAI compatible API for serving LLAMA-2 model☆218Updated last year
- The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge☆1,445Updated this week
- The Google mediapipe AI library. Write AI inference applications for image recognition, text classification, audio / video processing and…☆199Updated 9 months ago
- A cross-platform browser ML framework.☆709Updated 7 months ago
- Web-optimized vector database (written in Rust).☆248Updated 4 months ago
- Tensor library for machine learning☆275Updated 2 years ago
- Vercel and web-llm template to run wasm models directly in the browser.☆160Updated last year
- Approx nearest neighbor search in Rust☆165Updated 2 years ago
- Implementation of the RWKV language model in pure WebGPU/Rust.☆312Updated last week
- Inference Llama 2 in one file of pure Rust 🦀☆233Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆207Updated 5 months ago
- ☆138Updated last year
- JS tokenizer for LLaMA 1 and 2☆354Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆394Updated last week
- Lightweight database clients in the WasmEdge Runtime☆70Updated 11 months ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆272Updated 11 months ago
- Simple Rust applications that run in WasmEdge☆32Updated last year
- Continuous runtime observablity SDKs to monitor WebAssembly code.☆176Updated 10 months ago
- LLM Orchestrator built in Rust☆281Updated last year
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU☆102Updated 2 years ago
- Rust framework for LLM orchestration☆204Updated 11 months ago
- Octogen is an Open-Source Code Interpreter Agent Framework☆257Updated 11 months ago
- Run any ML model from any programming language.☆422Updated last year
- a fast cross platform AI inference engine 🤖 using Rust 🦀 and WebGPU 🎮☆454Updated 6 months ago
- Rust implementation of Surya☆58Updated 4 months ago
- Minimal LLM inference in Rust☆1,006Updated 8 months ago
- A template project to demonstrate how to run WebAssembly functions as sidecar microservices in dapr☆283Updated last year
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆792Updated this week