bigscience-workshop / petals
πΈ Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
β9,079Updated last week
Related projects: β
- OpenLLaMA, a permissively licensed open source reproduction of Meta AIβs LLaMA 7B trained on the RedPajama datasetβ7,339Updated last year
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMathβ9,194Updated last month
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)β11,200Updated this week
- A guidance language for controlling large language models.β18,698Updated this week
- Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.β9,731Updated last week
- Databricksβ Dolly, a large language model trained on the Databricks Machine Learning Platformβ10,812Updated last year
- Large Language Model Text Generation Inferenceβ8,762Updated this week
- QLoRA: Efficient Finetuning of Quantized LLMsβ9,906Updated 3 months ago
- Instruct-tune LLaMA on consumer hardwareβ18,537Updated last month
- π A list of open LLMs available for commercial use.β10,912Updated 2 months ago
- Home of StarCoder: fine-tuning & inference!β7,257Updated 6 months ago
- Locally run an Instruction-Tuned Chat-Style LLMβ10,252Updated last year
- Python bindings for llama.cppβ7,723Updated this week
- Tensor library for machine learningβ10,846Updated last week
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adβ¦β5,958Updated last week
- The simplest way to run LLaMA on your local machineβ13,093Updated 3 months ago
- Running large language models on a single GPU for throughput-oriented scenarios.β9,133Updated last month
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.β7,620Updated 4 months ago
- StableLM: Stability AI Language Modelsβ15,842Updated 5 months ago
- SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability vβ¦β6,524Updated this week
- the AI-native open-source embedding databaseβ14,555Updated this week
- Universal LLM Deployment Engine with ML Compilationβ18,642Updated this week
- Official inference library for Mistral modelsβ9,514Updated this week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.β7,085Updated last week
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinksβ6,537Updated 2 months ago
- OpenChat: Advancing Open-source Language Models with Imperfect Dataβ5,217Updated this week
- tiktoken is a fast BPE tokeniser for use with OpenAI's models.β11,796Updated last month
- The RedPajama-Data repository contains code for preparing large datasets for training large language models.β4,522Updated last month
- Create LLM agents with long-term memory and custom tools ππ¦β11,378Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMsβ26,822Updated this week