withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,636Updated this week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆873Updated 2 years ago
- Ollama JavaScript library☆3,627Updated 3 weeks ago
- A NodeJS RAG framework to easily work with LLMs and embeddings☆549Updated 2 months ago
- The TypeScript library for building AI applications.☆1,301Updated last year
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆514Updated 3 months ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆863Updated last month
- LM Studio TypeScript SDK☆1,310Updated last week
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆288Updated last year
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆174Updated last week
- Data framework for your LLM applications. Focus on server side solution☆2,830Updated this week
- A JavaScript library like PyTorch, with GPU acceleration.☆1,191Updated 9 months ago
- Node.js bindings for faiss☆134Updated last year
- 🕸️🦀 A WASM vector similarity search written in Rust☆994Updated last year
- Use Hugging Face with JavaScript☆2,203Updated last week
- JS port and JS/WASM bindings for openai/tiktoken☆923Updated 3 weeks ago
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆827Updated 3 months ago
- Developer friendly Natural Language Processing ✨☆1,293Updated 2 weeks ago
- gpt4all and llama typescript bindings☆398Updated last year
- ⬆ Dead simple, dependency-less, spec-compliant server-sent events implementation written in TypeScript☆724Updated last month
- structured extraction for llms☆748Updated 7 months ago
- A collection of 🤗 Transformers.js demos and example applications☆1,720Updated this week
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (o1, o3, o4, gpt-4o, gpt-4, etc.). Port of OpenAI's tiktoken…☆611Updated last week
- Local AI API Platform☆2,761Updated last month
- High performance Node.js webserver with a simple-to-use API powered by uWebsockets.js under the hood.☆1,977Updated 8 months ago
- Access to Anthropic's safety-first language model APIs☆1,176Updated this week
- The Ultimate Express. Fastest http server with full Express compatibility, based on µWebSockets.☆898Updated last week
- 🧵 Make web workers & worker threads as simple as a function call.☆3,487Updated last year
- 🧵 A minimal and tiny Node.js Worker Thread Pool implementation (38KB)☆1,477Updated 2 weeks ago
- Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses O…☆234Updated 8 months ago
- Simple, efficient, ultra-fast, scalable data store wrapper for LMDB☆580Updated 2 weeks ago