withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,605Updated last week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- A NodeJS RAG framework to easily work with LLMs and embeddings☆545Updated last month
- Ollama JavaScript library☆3,565Updated last month
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆874Updated 2 years ago
- The TypeScript library for building AI applications.☆1,301Updated last year
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆503Updated 2 months ago
- Data framework for your LLM applications. Focus on server side solution☆2,794Updated this week
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆785Updated 2 weeks ago
- JavaScript/Typescript SDK for Qdrant Vector Database☆356Updated 3 weeks ago
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆284Updated last year
- NodeJS Bindings for Whisper - the CPU version of OpenAI's Whisper, as initially crafted in C++ by ggerganov.☆159Updated last week
- LM Studio TypeScript SDK☆1,273Updated this week
- JS port and JS/WASM bindings for openai/tiktoken☆909Updated 3 months ago
- The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (o1, o3, o4, gpt-4o, gpt-4, etc.). Port of OpenAI's tiktoken…☆597Updated last month
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆478Updated last year
- A JavaScript library like PyTorch, with GPU acceleration.☆1,185Updated 8 months ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆274Updated last year
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆812Updated 3 months ago
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆400Updated 3 weeks ago
- Package your Node.js project into an executable☆685Updated 2 weeks ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆986Updated last year
- structured extraction for llms☆741Updated 6 months ago
- JS Client library for Mistral AI platform☆197Updated 9 months ago
- Machine learning framework for Node.js.☆262Updated 3 months ago
- ⬆ Dead simple, dependency-less, spec-compliant server-sent events implementation written in TypeScript☆707Updated last week
- Local AI API Platform☆2,765Updated last month
- Use Hugging Face with JavaScript☆2,190Updated this week
- Access to Anthropic's safety-first language model APIs☆1,140Updated this week
- Integrate 200+ LLMs with one TypeScript SDK using OpenAI's format.☆281Updated 3 months ago
- gpt4all and llama typescript bindings☆398Updated last year
- A Node.js library to parse text out of any office file. Currently supports docx, pptx, xlsx and odt, odp, ods..☆226Updated last month