withcatai / node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,477Updated last month
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Ollama JavaScript library☆3,349Updated 3 weeks ago
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆872Updated last year
- The TypeScript library for building AI applications.☆1,262Updated 9 months ago
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆690Updated 2 weeks ago
- LM Studio TypeScript SDK☆1,086Updated this week
- JS port and JS/WASM bindings for openai/tiktoken☆850Updated 3 weeks ago
- Data framework for your LLM applications. Focus on server side solution☆2,616Updated this week
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆259Updated 9 months ago
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆474Updated 10 months ago
- Utilities to use the Hugging Face Hub API☆1,663Updated this week
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆374Updated 3 weeks ago
- gpt4all and llama typescript bindings☆397Updated last year
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆273Updated 9 months ago
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆473Updated last week
- structured extraction for llms☆711Updated 3 months ago
- JavaScript/Typescript SDK for Qdrant Vector Database☆320Updated 3 weeks ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆952Updated last year
- Machine learning framework for Node.js.☆253Updated 3 weeks ago
- A NodeJS RAG framework to easily work with LLMs and embeddings☆501Updated this week
- Mac compatible Ollama Voice☆484Updated last year
- Converts Zod schemas to Json schemas☆1,088Updated last month
- Access to Anthropic's safety-first language model APIs☆974Updated this week
- Run Large-Language Models (LLMs) 🚀 directly in your browser!☆203Updated 8 months ago
- High performance Node.js webserver with a simple-to-use API powered by uWebsockets.js under the hood.☆1,921Updated 5 months ago
- Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.☆235Updated 3 weeks ago
- 📦 Zero-config package bundler for Node.js + TypeScript☆1,410Updated 2 weeks ago
- Browser-compatible JS library for running language models☆228Updated 2 years ago
- the terminal client for Ollama☆1,798Updated this week
- 🧵 A minimal and tiny Node.js Worker Thread Pool implementation (38KB)☆1,404Updated last month
- Local AI API Platform☆2,655Updated last week