withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,783Updated this week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Ollama JavaScript library☆3,840Updated this week
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆869Updated 2 years ago
- A NodeJS RAG framework to easily work with LLMs and embeddings☆592Updated 3 weeks ago
- LM Studio TypeScript SDK☆1,437Updated this week
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆950Updated 2 weeks ago
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆549Updated 7 months ago
- The TypeScript library for building AI applications.☆1,305Updated last year
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆186Updated last week
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆292Updated last year
- JavaScript/Typescript SDK for Qdrant Vector Database☆409Updated 2 weeks ago
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆905Updated 3 months ago
- JS port and JS/WASM bindings for openai/tiktoken☆992Updated 4 months ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆285Updated last year
- Data framework for your LLM applications. Focus on server side solution☆2,976Updated this week
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆479Updated 3 weeks ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,024Updated 2 years ago
- Offload tasks to a pool of workers on node.js and in the browser☆2,268Updated 2 weeks ago
- Machine learning framework for Node.js.☆273Updated 7 months ago
- Node.js bindings for faiss☆138Updated 2 years ago
- gpt4all and llama typescript bindings☆398Updated last year
- VS Code extension for LLM-assisted code/text completion☆1,098Updated 3 weeks ago
- A collection of 🤗 Transformers.js demos and example applications☆1,887Updated 3 weeks ago
- Local AI API Platform☆2,764Updated 5 months ago
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken wit…☆704Updated last month
- Native UI testing / controlling with node☆2,712Updated last year
- Build realtime multimodal AI agents with Node.js☆681Updated this week
- Library to generate vector embeddings in NodeJS☆163Updated 2 months ago
- A Node.js library to parse text out of any office file. Currently supports docx, pptx, xlsx and odt, odp, ods..☆250Updated last month
- structured extraction for llms☆759Updated 10 months ago
- 🧵 Make web workers & worker threads as simple as a function call.☆3,514Updated last year