Atome-FE / llama-node
Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.
☆872Updated last year
Alternatives and similar repositories for llama-node
Users that are interested in llama-node are comparing it to the libraries listed below
Sorting:
- gpt4all and llama typescript bindings☆397Updated last year
- Run AI ✨ assistant locally! with simple API for Node.js 🚀☆474Updated 10 months ago
- A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI…☆598Updated last year
- Everything you need to start building ChatGPT Plugins in JS/TS 🔥☆545Updated 2 years ago
- Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. Just useLLM().☆693Updated last year
- Run modern deep learning models in the browser.☆836Updated last year
- 🧬 The open source chat-ai toolkit☆906Updated last year
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,657Updated last year
- Simple UI for LLM Model Finetuning☆2,061Updated last year
- Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Tra…☆1,298Updated last year
- Javascript BPE Encoder Decoder for GPT-2 / GPT-3☆722Updated 2 years ago
- Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation le…☆1,492Updated this week
- fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…☆410Updated last year
- JS tokenizer for LLaMA 1 and 2☆351Updated 10 months ago
- JavaScript/Typescript SDK for Qdrant Vector Database☆326Updated 3 weeks ago
- 🕸️🦀 A WASM vector similarity search written in Rust☆954Updated last year
- INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model☆1,516Updated last month
- Chat with your favourite LLaMA models in a native macOS app☆1,502Updated last year
- The TypeScript library for building AI applications.☆1,262Updated 9 months ago
- An experiment concept for an AI brain.☆701Updated 2 years ago
- AI-powered task management system in Javascript☆380Updated 2 years ago
- Run Alpaca LLM in LangChain☆218Updated last year
- OpenAI's tiktoken but with node bindings☆104Updated 11 months ago
- Uses Auto-GPT with Llama.cpp☆386Updated last year
- C++ implementation for BLOOM☆812Updated 2 years ago
- Node.js bindings for OpenAI's Whisper. (C++ CPU version by ggerganov)☆273Updated 9 months ago
- JS port and JS/WASM bindings for openai/tiktoken☆850Updated 3 weeks ago
- The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer☆1,309Updated last year
- 🧠 Motorhead is a memory and information retrieval server for LLMs.☆878Updated last month
- Explore large language models in 512MB of RAM☆1,191Updated 2 months ago