mlc-ai / web-llmLinks
High-performance In-browser LLM Inference Engine
☆16,747Updated last week
Alternatives and similar repositories for web-llm
Users that are interested in web-llm are comparing it to the libraries listed below
Sorting:
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,693Updated last year
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆14,808Updated last week
- Universal LLM Deployment Engine with ML Compilation☆21,562Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,240Updated 5 months ago
- The simplest way to run LLaMA on your local machine☆13,038Updated last year
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,905Updated last week
- Locally run an Instruction-Tuned Chat-Style LLM☆10,198Updated 2 years ago
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆45,140Updated this week
- 🦜🔗 Build context-aware reasoning applications 🦜🔗☆16,231Updated this week
- Open-source search and retrieval database for AI applications.☆24,264Updated this week
- LLM inference in C/C++☆89,278Updated this week
- A guidance language for controlling large language models.☆20,893Updated 3 weeks ago
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,532Updated last week
- Tensor library for machine learning☆13,361Updated last week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,817Updated 4 months ago
- Home of StarCoder: fine-tuning & inference!☆7,472Updated last year
- The definitive Web UI for local AI, with powerful features and easy setup.☆45,348Updated this week
- An LLM playground you can run on your laptop☆6,363Updated last month
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,831Updated last year
- Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.☆3,740Updated last year
- Instruct-tune LLaMA on consumer hardware☆18,977Updated last year
- ☆21,917Updated last year
- Open-source vector similarity search for Postgres☆18,287Updated last week
- 🦜🔗 The platform for reliable agents.☆118,938Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆76,874Updated 5 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,734Updated last year
- Inference code for Llama models☆58,905Updated 9 months ago
- Distribute and run LLMs with a single file.☆23,341Updated this week
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆17,228Updated last week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,458Updated 5 months ago