mlc-ai / web-llmLinks
High-performance In-browser LLM Inference Engine
☆16,885Updated last week
Alternatives and similar repositories for web-llm
Users that are interested in web-llm are comparing it to the libraries listed below
Sorting:
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,700Updated last year
- Universal LLM Deployment Engine with ML Compilation☆21,691Updated last week
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆14,971Updated this week
- Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.☆3,776Updated last year
- Tensor library for machine learning☆13,648Updated last week
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,839Updated last year
- Large Language Model Text Generation Inference☆10,684Updated 2 weeks ago
- 📋 A list of open LLMs available for commercial use.☆12,527Updated 9 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,287Updated 6 months ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,816Updated last year
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,528Updated 2 years ago
- A guidance language for controlling large language models.☆20,960Updated last week
- Python bindings for llama.cpp☆9,786Updated 3 months ago
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,965Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,578Updated 2 weeks ago
- ☆21,983Updated last year
- Inference code for Llama models☆58,948Updated 10 months ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,849Updated 4 months ago
- 🦜🔗 Build context-aware reasoning applications☆16,398Updated last week
- TypeChat is a library that makes it easy to build natural language interfaces using types.☆8,588Updated last week
- Open source codebase powering the HuggingChat app☆10,303Updated last week
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, o…☆9,016Updated last week
- Open-source search and retrieval database for AI applications.☆24,634Updated last week
- <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agent…☆16,902Updated 10 months ago
- Instruct-tune LLaMA on consumer hardware☆18,983Updated last year
- Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.☆2,677Updated last year
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,237Updated last year
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆76,936Updated 6 months ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,177Updated 2 weeks ago
- An LLM playground you can run on your laptop☆6,365Updated 2 months ago