mlc-ai / mlc-llmLinks
Universal LLM Deployment Engine with ML Compilation
☆20,950Updated this week
Alternatives and similar repositories for mlc-llm
Users that are interested in mlc-llm are comparing it to the libraries listed below
Sorting:
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆38,825Updated last month
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,532Updated last year
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,341Updated 8 months ago
- Tensor library for machine learning☆12,808Updated this week
- Instruct-tune LLaMA on consumer hardware☆18,921Updated 11 months ago
- OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…☆37,408Updated 10 months ago
- StableLM: Stability AI Language Models☆15,824Updated last year
- Python bindings for llama.cpp☆9,313Updated this week
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,428Updated last month
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆22,992Updated 10 months ago
- Inference code for Llama models☆58,477Updated 5 months ago
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,065Updated 11 months ago
- Large Language Model Text Generation Inference☆10,311Updated this week
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,700Updated 10 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs