withcatai / node-llama-cppLinks
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
☆1,520Updated this week
Alternatives and similar repositories for node-llama-cpp
Users that are interested in node-llama-cpp are comparing it to the libraries listed below
Sorting:
- Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llam…☆871Updated last year
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆737Updated last month
- A NodeJS RAG framework to easily work with LLMs and embeddings☆515Updated last week
- Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.☆480Updated 3 weeks ago
- Ollama JavaScript library☆3,422Updated this week
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆473Updated 11 months ago
- Data framework for your LLM applications. Focus on server side solution☆2,660Updated this week
- The TypeScript library for building AI applications.☆1,276Updated 10 months ago
- A collection of 🤗 Transformers.js demos and example applications☆1,477Updated 3 weeks ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆267Updated 10 months ago
- A minimalist bytecode compiler for Node.js☆2,783Updated 3 months ago
- Local AI API Platform☆2,715Updated 3 weeks ago
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆275Updated 10 months ago
- LM Studio TypeScript SDK☆1,138Updated this week
- 🕸️🦀 A WASM vector similarity search written in Rust☆967Updated last year
- Machine learning framework for Node.js.☆255Updated last month
- Small and modular JavaScript runtime for desktop and mobile☆825Updated last week
- Access to Anthropic's safety-first language model APIs☆1,016Updated this week
- Node.js bindings for faiss☆132Updated last year
- gpt4all and llama typescript bindings☆397Updated last year
- JavaScript/Typescript SDK for Qdrant Vector Database☆332Updated 2 weeks ago
- pgvector support for Node.js, Deno, and Bun (and TypeScript)☆382Updated 2 weeks ago
- Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.☆755Updated last month
- A JavaScript library like PyTorch, with GPU acceleration.☆1,168Updated 6 months ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆13,707Updated this week
- Build ultra fast, tiny, and cross-platform desktop apps with Typescript.☆1,918Updated this week
- An objective comparison of multiple frameworks that allow us to "transform" our web apps to desktop applications.☆1,682Updated this week
- VS Code extension for LLM-assisted code/text completion☆778Updated last week
- Web api for using VITS based models in the browser!☆205Updated 8 months ago
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,196Updated last week