mlc-ai / web-llmLinks
High-performance In-browser LLM Inference Engine
☆16,427Updated 4 months ago
Alternatives and similar repositories for web-llm
Users that are interested in web-llm are comparing it to the libraries listed below
Sorting:
- A guidance language for controlling large language models.☆20,681Updated last week
- Universal LLM Deployment Engine with ML Compilation☆21,302Updated last week
- Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.☆3,683Updated last year
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,758Updated last week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,761Updated 2 months ago
- ☆21,812Updated 10 months ago
- State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!☆14,536Updated this week
- Open source codebase powering the HuggingChat app☆9,145Updated last month
- Run GPT model on the browser with WebGPU. An implementation of GPT inference in less than ~1500 lines of vanilla Javascript.☆3,729Updated last year
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆28,893Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆44,256Updated this week
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,148Updated last year
- Instruct-tune LLaMA on consumer hardware☆18,957Updated last year
- OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…☆37,466Updated last year
- StableLM: Stability AI Language Models☆15,806Updated last year
- Port of OpenAI's Whisper model in C/C++☆43,252Updated last week
- Locally run an Instruction-Tuned Chat-Style LLM☆10,212Updated 2 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,096Updated 3 months ago
- Open-source search and retrieval database for AI applications.☆23,272Updated this week
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,225Updated last year
- 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.☆34,911Updated 4 months ago
- LLM inference in C/C++☆86,426Updated this week
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,526Updated 2 years ago
- Distribute and run LLMs with a single file.☆23,105Updated 2 months ago
- Large Language Model Text Generation Inference☆10,491Updated last week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,410Updated last week
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆16,931Updated 8 months ago
- Tensor library for machine learning☆13,134Updated last week
- DSPy: The framework for programming—not prompting—language models☆28,156Updated this week
- TypeChat is a library that makes it easy to build natural language interfaces using types.☆8,557Updated 2 months ago