wizzard0 / llama2.ts
Llama2 inference in one TypeScript file
☆14Updated 3 months ago
Related projects: ⓘ
- Inference Llama 2 in one file of pure JavaScript(HTML)☆28Updated 2 months ago
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU☆102Updated last year
- Simple repo that compiles and runs llama2.c on the Web☆52Updated 10 months ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆63Updated 9 months ago
- JavaScript bindings for the ggml-js library☆39Updated 9 months ago
- WebContainers, except it's a million times easier to use☆22Updated last year
- ☆31Updated 11 months ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆183Updated last month
- iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh☆45Updated 10 months ago
- Web browser version of StarCoder.cpp☆43Updated last year
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆42Updated last month
- webassembly binding for Hora Approximate Nearest Neighbor Search Library☆54Updated 3 years ago
- Smart Whisper is a native Node.js addon designed for efficient and streamlined interaction with the whisper.cpp, with automatic model off…☆22Updated 3 weeks ago
- JS tokenizer for LLaMA 3 and LLaMA 3.1☆79Updated last month
- wasm bindings for huggingface tokenizers library☆36Updated 2 years ago
- Run Large-Language Models (LLMs) 🚀 directly in your browser!☆159Updated last week
- JSON parser for streaming objects live from an LLM's output☆25Updated 7 months ago
- A JavaScript implementation of Llama 3 using node-mlx.☆68Updated 2 months ago
- Vercel and web-llm template to run wasm models directly in the browser.☆113Updated 9 months ago
- hnswlib-wasm attempts to create a browser friendly version of hnswlib☆42Updated last year
- ☆47Updated this week
- Web-optimized vector database (written in Rust).☆186Updated 2 months ago
- ☆70Updated this week
- Express.js ported to a Service Worker context☆17Updated 8 months ago
- ☆28Updated last year
- BlinkDL's RWKV-v4 running in the browser☆46Updated last year
- A JavaScript to WebAssembly transpiler☆37Updated 10 months ago
- Library to generate vector embeddings in NodeJS☆66Updated 3 weeks ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆60Updated 4 months ago
- A JavaScript and TypeScript port of PyTorch C++ library (libtorch) - Node.js N-API bindings for libtorch.☆15Updated last year