mlc-ai / mlc-llmLinks
Universal LLM Deployment Engine with ML Compilation
☆21,423Updated last week
Alternatives and similar repositories for mlc-llm
Users that are interested in mlc-llm are comparing it to the libraries listed below
Sorting:
- Tensor library for machine learning☆13,222Updated last week
- Instruct-tune LLaMA on consumer hardware☆18,961Updated last year
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,144Updated 4 months ago
- Large Language Model Text Generation Inference☆10,539Updated 3 weeks ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,458Updated 4 months ago
- LLM inference in C/C++☆87,149Updated this week
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,369Updated 11 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,679Updated last year
- Python bindings for llama.cpp☆9,635Updated last month
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,803Updated last year
- Inference code for Llama models☆58,786Updated 8 months ago
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,166Updated last year
- The definitive Web UI for local AI, with powerful features and easy setup.☆45,125Updated 2 weeks ago
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆44,575Updated this week
- StableLM: Stability AI Language Models