withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,808Updated 3 weeks ago
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Ollama JavaScript library☆3,876Updated 3 weeks ago
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆868Updated 2 years ago
- A NodeJS RAG framework to easily work with LLMs and embeddings☆594Updated last month
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆556Updated 7 months ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆965Updated 3 weeks ago
- LM Studio TypeScript SDK☆1,450Updated last week
- Data framework for your LLM applications. Focus on server side solution☆3,005Updated 3 weeks ago
- JavaScript/Typescript SDK for Qdrant Vector Database☆412Updated last month
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆293Updated last year
- The TypeScript library for building AI applications.☆1,307Updated last year
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆191Updated 3 weeks ago
- A JavaScript library like PyTorch, with GPU acceleration.☆1,221Updated last year
- Node.js bindings for faiss☆138Updated 2 years ago
- Machine learning framework for Node.js.☆274Updated 8 months ago
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken wit…☆714Updated this week
- Generate vector embeddings in NodeJS☆169Updated 3 weeks ago
- JS port and JS/WASM bindings for openai/tiktoken☆1,000Updated 4 months ago
- The Ultimate Express. Fastest http server with full Express compatibility, based on µWebSockets.☆1,024Updated this week
- The JavaScript Database, for Node.js, nw.js, electron and the browser☆415Updated 6 months ago
- Call Python from NodeJS directly in-process without spawning processes☆283Updated last month
- Use Hugging Face with JavaScript☆2,316Updated this week
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,036Updated 2 years ago
- Local AI API Platform☆2,763Updated 6 months ago
- JS Client library for Mistral AI platform☆197Updated last year
- Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses O…☆242Updated last year
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆918Updated 4 months ago
- Vercel AI Provider for running LLMs locally using Ollama☆337Updated 11 months ago
- This SDK is now deprecated, use the new unified Google GenAI SDK.☆1,236Updated last month
- A collection of 🤗 Transformers.js demos and example applications☆1,912Updated last month
- Web api for using VITS based models in the browser!☆233Updated last year