antimatter15 / alpaca.cpp

Related projects ⓘ

Alternatives and complementary repositories for alpaca.cpp

• cocktailpeanut / dalai
  The simplest way to run LLaMA on your local machine
  ☆13,089Updated 4 months ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,630Updated 3 months ago
• tatsu-lab / stanford_alpaca
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆29,518Updated 3 months ago
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,831Updated 7 months ago
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,383Updated last year
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,257Updated 3 months ago
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆36,902Updated this week
• bigcode-project / starcoder
  Home of StarCoder: fine-tuning & inference!
  ☆7,310Updated 8 months ago
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,186Updated last week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆19,130Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.
  ☆9,993Updated this week
• LAION-AI / Open-Assistant
  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…
  ☆37,043Updated 2 months ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,224Updated 2 months ago
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆5,988Updated 2 months ago
• ggerganov / ggml
  Tensor library for machine learning
  ☆11,160Updated this week
• BlinkDL / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆12,630Updated last week
• BlinkDL / ChatRWKV
  ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
  ☆9,420Updated 3 months ago
• togethercomputer / RedPajama-Data
  The RedPajama-Data repository contains code for preparing large datasets for training large language models.
  ☆4,564Updated 3 weeks ago
• microsoft / JARVIS
  JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
  ☆23,679Updated last month
• nat / openplayground
  An LLM playground you can run on your laptop
  ☆6,249Updated last week
• run-llama / llama_index
  LlamaIndex is a data framework for your LLM applications
  ☆36,534Updated this week
• ggerganov / llama.cpp
  LLM inference in C/C++
  ☆67,437Updated this week
• yoheinakajima / babyagi
  ☆20,393Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,028Updated 4 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,072Updated this week
• nichtdax / awesome-totally-open-chatgpt
  A list of totally open alternatives to ChatGPT
  ☆4,527Updated last year
• togethercomputer / OpenChatKit
  ☆9,002Updated 7 months ago
• oobabooga / text-generation-webui
  A Gradio web UI for Large Language Models.
  ☆40,514Updated this week
• deep-diver / LLM-As-Chatbot
  LLM as a Chatbot Service
  ☆3,290Updated 11 months ago