withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,714Updated last week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆870Updated 2 years ago
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆532Updated 5 months ago
- Ollama JavaScript library☆3,741Updated last week
- The TypeScript library for building AI applications.☆1,301Updated last year
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆920Updated 3 weeks ago
- LM Studio TypeScript SDK☆1,380Updated this week
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆291Updated last year
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆181Updated this week
- JS port and JS/WASM bindings for openai/tiktoken☆971Updated 2 months ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆1,000Updated 2 years ago
- JavaScript/Typescript SDK for Qdrant Vector Database☆394Updated last week
- Data framework for your LLM applications. Focus on server side solution☆2,934Updated this week
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆477Updated last year
- Node.js bindings for faiss☆138Updated 2 years ago
- Use Hugging Face with JavaScript☆2,271Updated this week
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆284Updated last year
- A collection of 🤗 Transformers.js demos and example applications☆1,801Updated last month
- Vercel AI Provider for running LLMs locally using Ollama☆335Updated 9 months ago
- gpt4all and llama typescript bindings☆397Updated last year
- Use self-hosted LLMs with an OpenAI compatible API☆64Updated last year
- Package your Node.js project into an executable☆766Updated 2 weeks ago
- Machine learning framework for Node.js.☆267Updated 6 months ago
- JS Client library for Mistral AI platform☆194Updated last year
- structured extraction for llms☆754Updated 9 months ago
- Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.☆2,666Updated last year
- Local AI API Platform☆2,760Updated 3 months ago
- ML-powered speech recognition directly in your browser☆3,125Updated last year
- IMAP Client library for EmailEngine Email API (https://emailengine.app)☆476Updated last week
- ⬆ Dead simple, dependency-less, spec-compliant server-sent events implementation written in TypeScript☆763Updated this week
- A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…☆221Updated last year