withcatai / node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,268Updated this week
Alternatives and similar repositories for node-llama-cpp:
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆870Updated last year
- A NodeJS RAG framework to easily work with LLMs and embeddings☆415Updated this week
- Ollama JavaScript library☆2,999Updated this week
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆575Updated this week
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆255Updated 6 months ago
- Node.js bindings for faiss☆117Updated last year
- The TypeScript library for building AI applications.☆1,221Updated 6 months ago
- Replace Copilot local AI☆1,944Updated 9 months ago
- Utilities to use the Hugging Face Hub API☆1,519Updated this week
- Data framework for your LLM applications. Focus on server side solution☆2,267Updated this week
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆467Updated 7 months ago
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆349Updated 2 weeks ago
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆617Updated 2 weeks ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆234Updated 6 months ago
- A JavaScript library like PyTorch, with GPU acceleration.☆1,117Updated 3 months ago
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆433Updated 2 months ago
- structured extraction for llms☆659Updated 2 weeks ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆914Updated last year
- 👾 LM Studio TypeScript SDK (pre-release public alpha)☆771Updated this week
- Local AI API Platform☆2,451Updated this week
- 🧵 A minimal and tiny Node.js Worker Thread Pool implementation (38KB)☆1,363Updated 3 months ago
- The unofficial DSPy framework. Build LLM powered Agents and "Agentic workflows" based on the Stanford DSP paper.☆1,290Updated this week
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆111Updated this week
- basic websocket support for fastify☆414Updated last week
- Machine learning framework for Node.js.☆187Updated last week
- Use your own AI models on the web☆910Updated 6 months ago
- Library to generate vector embeddings in NodeJS☆103Updated 2 months ago
- 💬 Chat with the LangChain JS/TS documentation, with sources. 💬☆296Updated 6 months ago
- Framework to build resilient language agents as graphs.☆969Updated this week
- Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.☆871Updated last week