Alternatives and similar repositories for petals

Users that are interested in petals are comparing it to the libraries listed below

• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,526Updated 2 years ago
• imoneoi / openchat
  OpenChat: Advancing Open-source Language Models with Imperfect Data
  ☆5,430Updated 11 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,458Updated 3 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,491Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,212Updated 2 years ago
• togethercomputer / RedPajama-Data
  The RedPajama-Data repository contains code for preparing large datasets for training large language models.
  ☆4,805Updated 9 months ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,134Updated this week
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,364Updated 10 months ago
• cocktailpeanut / dalai
  The simplest way to run LLaMA on your local machine
  ☆13,059Updated last year
• nebuly-ai / optimate
  A collection of libraries to optimise AI model performances
  ☆8,369Updated last year
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,957Updated last year
• ShishirPatil / gorilla
  Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
  ☆12,396Updated 2 weeks ago
• lucidrains / PaLM-rlhf-pytorch
  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
  ☆7,865Updated last week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,656Updated last year
• lxe / simple-llm-finetuner
  Simple UI for LLM Model Finetuning
  ☆2,067Updated last year
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆21,302Updated this week
• qdrant / qdrant
  Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…
  ☆25,761Updated last week
• bigcode-project / starcoder
  Home of StarCoder: fine-tuning & inference!
  ☆7,448Updated last year
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,079Updated 2 months ago
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,452Updated 5 months ago
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,804Updated last year
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,898Updated last year
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆7,035Updated last year
• stochasticai / xTuring
  Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-sour…
  ☆2,658Updated 11 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,546Updated 3 weeks ago
• skypilot-org / skypilot
  Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, o…
  ☆8,613Updated last week
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,741Updated last year
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,309Updated 3 weeks ago
• young-geng / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆2,496Updated last year
• togethercomputer / OpenChatKit
  ☆9,022Updated last year