Alternatives and similar repositories for mpt-30B-inference:

Users that are interested in mpt-30B-inference are comparing it to the libraries listed below

• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆454Updated last year
• Nuggt-dev / Nuggt
  An Autonomous LLM Agent that runs on Wizcoder-15B
  ☆335Updated 6 months ago
• salesforce / xgen
  Salesforce open-source LLMs with 8k sequence length.
  ☆717Updated 3 months ago
• jondurbin / airoboros
  Customizable implementation of the self-instruct paper.
  ☆1,044Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• freddyaboulton / gradio-tools
  ☆592Updated last year
• danielgross / LlamaAcademy
  A school for camelids
  ☆1,209Updated 2 years ago
• melodysdreamj / WizardVicunaLM
  LLM that combines the principles of wizardLM and vicunaLM
  ☆717Updated last year
• paolorechia / learn-langchain
  ☆277Updated last year
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆820Updated 2 years ago
• CStanKonrad / long_llama
  LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transform…
  ☆1,452Updated last year
• NouamaneTazi / bloomz.cpp
  C++ implementation for BLOOM
  ☆811Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• rlancemartin / auto-evaluator
  Evaluation tool for LLM QA chains
  ☆1,075Updated last year
• teknium1 / GPTeacher
  A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer
  ☆1,630Updated last year
• zetavg / LLaMA-LoRA-Tuner
  UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT…
  ☆469Updated last year
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆410Updated last year
• jina-ai / agentchain
  Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks
  ☆604Updated 2 years ago
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆586Updated last year
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆114Updated last year
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆466Updated last year
• BlackHC / llm-strategy
  Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types
  ☆397Updated 2 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆324Updated 2 years ago
• ctlllll / LLM-ToolMaker
  ☆1,029Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆711Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆310Updated last year
• shm007g / LLaMA-Cult-and-More
  Large Language Models for All, 🦙 Cult and More, Stay in touch !
  ☆446Updated last year
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆371Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆488Updated last year