withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,856Updated last week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- A NodeJS RAG framework to easily work with LLMs and embeddings☆599Updated 2 months ago
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆575Updated 2 weeks ago
- LM Studio TypeScript SDK☆1,479Updated this week
- The TypeScript library for building AI applications.☆1,312Updated last year
- Ollama JavaScript library☆3,955Updated 2 weeks ago
- Data framework for your LLM applications. Focus on server side solution☆3,036Updated last week
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆987Updated last month
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆941Updated 5 months ago
- A JavaScript library like PyTorch, with GPU acceleration.☆1,223Updated last year
- JavaScript/Typescript SDK for Qdrant Vector Database☆417Updated 2 months ago
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆295Updated last year
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆481Updated 2 months ago
- Local AI API Platform☆2,762Updated 7 months ago
- Use Hugging Face with JavaScript☆2,339Updated this week
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,046Updated 2 years ago
- Node.js bindings for faiss☆138Updated 2 years ago
- JS port and JS/WASM bindings for openai/tiktoken☆1,008Updated 5 months ago
- structured extraction for llms☆765Updated last year
- Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.☆2,678Updated last year
- Replace Copilot local AI☆2,084Updated last year
- A collection of 🤗 Transformers.js demos and example applications☆1,940Updated 2 months ago
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆430Updated 3 weeks ago
- Call Python from NodeJS directly in-process without spawning processes☆283Updated last week
- Machine learning framework for Node.js.☆278Updated 9 months ago
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken wit…☆729Updated last month
- ML-powered speech recognition directly in your browser☆3,230Updated last year
- Framework to build resilient language agents as graphs.☆2,507Updated this week
- JavaScript OCR and text extraction for images and PDFs.☆255Updated last week
- The Ultimate Express. Fastest http server with full Express compatibility, based on µWebSockets.☆1,037Updated last week
- Nodebox is a runtime for executing Node.js modules in the browser.☆864Updated 2 years ago