withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,685Updated last week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆871Updated 2 years ago
- A NodeJS RAG framework to easily work with LLMs and embeddings☆561Updated 3 months ago
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆523Updated 4 months ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆901Updated last month
- Ollama JavaScript library☆3,698Updated last week
- A JavaScript library like PyTorch, with GPU acceleration.☆1,202Updated 10 months ago
- The TypeScript library for building AI applications.☆1,301Updated last year
- LM Studio TypeScript SDK☆1,353Updated last week
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆291Updated last year
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆180Updated this week
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆852Updated last month
- 🕸️🦀 A WASM vector similarity search written in Rust☆997Updated 2 years ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆281Updated last year
- Node.js bindings for faiss☆136Updated last year
- gpt4all and llama typescript bindings☆397Updated last year
- Offload tasks to a pool of workers on node.js and in the browser☆2,228Updated last month
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆405Updated last month
- Developer friendly Natural Language Processing ✨☆1,308Updated 2 months ago
- Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.☆294Updated 5 months ago
- Data framework for your LLM applications. Focus on server side solution☆2,907Updated this week
- Use Hugging Face with JavaScript☆2,247Updated this week
- Web api for using VITS based models in the browser!☆224Updated last year
- Local AI API Platform☆2,760Updated 3 months ago
- JS port and JS/WASM bindings for openai/tiktoken☆951Updated 2 months ago
- Call Python from NodeJS directly in-process without spawning processes☆281Updated 2 months ago
- Package your Node.js project into an executable☆742Updated 2 weeks ago
- 🧵 Make web workers & worker threads as simple as a function call.☆3,498Updated last year
- Native UI testing / controlling with node☆2,653Updated last year
- High performance Node.js webserver with a simple-to-use API powered by uWebsockets.js under the hood.☆1,991Updated 10 months ago
- Run Large-Language Models (LLMs) 🚀 directly in your browser!☆217Updated last year