withcatai / node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
☆837Updated this week
Related projects: ⓘ
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆863Updated last year
- LlamaIndex in TypeScript☆1,771Updated this week
- Ollama JavaScript library☆1,947Updated last week
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆359Updated last month
- A NodeJS RAG framework to easily work with LLMs and embeddings☆254Updated this week
- gpt4all and llama typescript bindings☆397Updated 6 months ago
- The TypeScript library for building AI applications.☆1,100Updated 2 months ago
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆223Updated last month
- Utilities to use the Hugging Face Hub API☆1,356Updated this week
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆443Updated 2 months ago
- Access to Anthropic's safety-first language model APIs☆638Updated this week
- JavaScript/Typescript SDK for Qdrant Vector Database☆239Updated last month
- Node.js bindings for faiss☆107Updated 11 months ago
- JS port and JS/WASM bindings for openai/tiktoken☆692Updated last month
- Voice activity detector (VAD) for the browser with a simple API☆773Updated last month
- ⚡ Build language agents as graphs ⚡☆486Updated this week
- LM Studio TypeScript SDK (pre-release public alpha)☆406Updated this week
- 🕸️🦀 A WASM vector similarity search written in Rust☆868Updated 11 months ago
- Run and customize Local LLMs.☆1,909Updated this week
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆79Updated this week
- React Native binding of llama.cpp☆232Updated 3 weeks ago
- structured extraction for llms☆517Updated 2 months ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆183Updated last month
- JS Client library for Mistral AI platform☆178Updated 3 months ago
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆309Updated last month
- WebAssembly binding for llama.cpp - Enabling in-browser LLM inference☆342Updated last week
- Use your own AI models on the web☆834Updated last month
- A SQLite extension for efficient vector search, based on Faiss!☆1,691Updated 4 months ago
- Run Large-Language Models (LLMs) 🚀 directly in your browser!☆159Updated last week
- React hook for OpenAI Whisper with speech recorder, real-time transcription, and silence removal built-in☆707Updated 4 months ago