mlc-ai / mlc-llmLinks
Universal LLM Deployment Engine with ML Compilation
☆21,302Updated this week
Alternatives and similar repositories for mlc-llm
Users that are interested in mlc-llm are comparing it to the libraries listed below
Sorting:
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,096Updated 3 months ago
- Tensor library for machine learning☆13,134Updated last week
- LLM inference in C/C++☆86,426Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,458Updated 3 months ago
- High-performance In-browser LLM Inference Engine☆16,427Updated 4 months ago
- Instruct-tune LLaMA on consumer hardware☆18,957Updated last year
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,144Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,656Updated last year
- Large Language Model Text Generation Inference☆10,491Updated last week
- The definitive Web UI for local AI, with powerful features and easy setup.☆44,962Updated last week
- StableLM: Stability AI Language Models☆15,806Updated last year
- Python bindings for llama.cpp☆9,566Updated last month
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,526Updated 2 years ago
- Inference code for Llama models☆58,737Updated 7 months ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆13,965Updated this week
- High-speed Large Language Model Serving for Local Deployment☆8,329Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆58,035Updated this week
- JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf☆24,343Updated last month
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆44,256Updated this week
- Home of StarCoder: fine-tuning & inference!☆7,449Updated last year
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆23,538Updated last year
- ☆21,812Updated 10 months ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆8,741Updated last year
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆76,672Updated 3 months ago
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.☆4,942Updated 5 months ago
- Locally run an Instruction-Tuned Chat-Style LLM☆10,212Updated 2 years ago
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆17,815Updated last week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆19,570Updated this week
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,410Updated last week
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,038Updated last year