withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,579Updated last month
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆873Updated last year
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆770Updated this week
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆500Updated 2 months ago
- The TypeScript library for building AI applications.☆1,291Updated 11 months ago
- Data framework for your LLM applications. Focus on server side solution☆2,740Updated this week
- Ollama JavaScript library☆3,534Updated last week
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆154Updated this week
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆282Updated 11 months ago
- A JavaScript library like PyTorch, with GPU acceleration.☆1,182Updated 8 months ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆983Updated last year
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆474Updated last year
- JavaScript/Typescript SDK for Qdrant Vector Database☆350Updated this week
- Machine learning framework for Node.js.☆258Updated 2 months ago
- Node.js bindings for faiss☆134Updated last year
- JS port and JS/WASM bindings for openai/tiktoken☆896Updated 2 months ago
- gpt4all and llama typescript bindings☆397Updated last year
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆394Updated this week
- A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…☆211Updated last year
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (o1, o3, o4, gpt-4o, gpt-4, etc.). Port of OpenAI's tiktoken…☆585Updated last month
- Offload tasks to a pool of workers on node.js and in the browser☆2,204Updated 2 weeks ago
- Call Python from NodeJS directly in-process without spawning processes☆274Updated 3 months ago
- Trigger functions or evaluate cron expressions in JavaScript or TypeScript. No dependencies. Most features. Node. Deno. Bun. Browser.☆2,290Updated last week
- Package your Node.js project into an executable☆667Updated 3 weeks ago
- structured extraction for llms☆734Updated 5 months ago
- Use Hugging Face with JavaScript☆2,171Updated this week
- Developer friendly Natural Language Processing ✨☆1,285Updated 2 weeks ago
- The Ultimate Express. Fastest http server with full Express compatibility, based on µWebSockets.☆837Updated 2 weeks ago
- Vercel AI Provider for running LLMs locally using Ollama☆314Updated 6 months ago
- ⬆ Dead simple, dependency-less, spec-compliant server-sent events implementation written in TypeScript.☆694Updated last month
- Interactive JavaScript and TypeScript programming with Jupyter☆815Updated last year