meta-llama / llama
Inference code for Llama models
☆57,227Updated 4 months ago
Alternatives and similar repositories for llama:
Users that are interested in llama are comparing it to the libraries listed below
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆29,738Updated 6 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆37,496Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆36,255Updated this week
- Inference code for CodeLlama models☆16,150Updated 5 months ago
- Instruct-tune LLaMA on consumer hardware☆18,758Updated 5 months ago
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆38,057Updated this week
- JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf☆23,871Updated 3 months ago
- Universal LLM Deployment Engine with ML Compilation☆19,630Updated this week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆16,978Updated this week
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆15,910Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆38,486Updated last month
- Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"☆11,119Updated last month
- 🦜🔗 Build context-aware reasoning applications☆98,422Updated this week
- Making large AI models cheaper, faster and more accessible☆39,013Updated last week
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,168Updated 7 months ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆13,005Updated last week
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆35,268Updated this week
- LLM inference in C/C++☆70,826Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.☆13,023Updated 3 months ago
- Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)☆25,536Updated 4 months ago
- ☆34,540Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆33,809Updated this week
- StableLM: Stability AI Language Models☆15,831Updated 9 months ago
- Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.☆15,344Updated 3 weeks ago
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆71,730Updated this week
- Examples and guides for using the OpenAI API☆61,164Updated this week
- The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.☆21,094Updated 6 months ago
- Official inference library for Mistral models☆9,857Updated 2 months ago
- Inference Llama 2 in one file of pure C☆17,858Updated 5 months ago