mlc-ai / web-llmLinks
High-performance In-browser LLM Inference Engine
☆16,313Updated 3 months ago
Alternatives and similar repositories for web-llm
Users that are interested in web-llm are comparing it to the libraries listed below
Sorting:
- Universal LLM Deployment Engine with ML Compilation☆21,192Updated this week
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,678Updated last year
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,030Updated 2 months ago
- Tensor library for machine learning☆13,086Updated this week
- StableLM: Stability AI Language Models☆15,811Updated last year
- Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.☆3,716Updated last year
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,729Updated this week
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,775Updated 11 months ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,457Updated 2 months ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆14,437Updated this week
- Inference code for CodeLlama models☆16,351Updated last year
- ☆9,018Updated last year
- Instruct-tune LLaMA on consumer hardware☆18,952Updated last year
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,518Updated 2 years ago
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆43,912Updated this week
- An LLM playground you can run on your laptop☆6,358Updated 3 weeks ago
- Large Language Model Text Generation Inference☆10,455Updated this week
- 🦜🔗 Build context-aware reasoning applications 🦜🔗☆15,519Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,362Updated this week
- The simplest way to run LLaMA on your local machine☆13,059Updated last year
- Open-source, secure environment with real-world tools for enterprise-grade agents.☆9,405Updated this week
- ☆21,788Updated 9 months ago
- Open-source search and retrieval database for AI applications.☆22,798Updated this week
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, o…☆8,585Updated this week
- Python bindings for llama.cpp☆9,515Updated 2 weeks ago
- Open source codebase powering the HuggingChat app☆9,106Updated 3 weeks ago
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆49,169Updated last week
- LLM inference in C/C++☆85,819Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆76,580Updated 3 months ago
- Distribute and run LLMs with a single file.☆23,025Updated 2 months ago