Alternatives and similar repositories for mpt-30B-inference:

Users that are interested in mpt-30B-inference are comparing it to the libraries listed below

• paolorechia / learn-langchain
  ☆276Updated last year
• NouamaneTazi / bloomz.cpp
  C++ implementation for BLOOM
  ☆810Updated last year
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆820Updated last year
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆452Updated last year
• danielgross / LlamaAcademy
  A school for camelids
  ☆1,210Updated last year
• BlackHC / llm-strategy
  Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types
  ☆394Updated last week
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆324Updated last year
• freddyaboulton / gradio-tools
  ☆586Updated last year
• teknium1 / GPTeacher
  A collection of modular datasets generated by GPT-4, General-Instruct - Roleplay-Instruct - Code-Instruct - and Toolformer
  ☆1,626Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆311Updated last year
• Nuggt-dev / Nuggt
  An Autonomous LLM Agent that runs on Wizcoder-15B
  ☆336Updated 4 months ago
• jondurbin / airoboros
  Customizable implementation of the self-instruct paper.
  ☆1,039Updated last year
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆466Updated last year
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆408Updated last year
• yxuansu / OpenAlpaca
  OpenAlpaca: A Fully Open-Source Instruction-Following Model Based On OpenLLaMA
  ☆301Updated last year
• toolkit-ai / toolkit-ai
  AI-agents that automatically generate and use Langchain Tools and ChatGPT plugins
  ☆530Updated last year
• rlancemartin / auto-evaluator
  Evaluation tool for LLM QA chains
  ☆1,070Updated last year
• e-johnstonn / BriefGPT
  Locally hosted tool that connects documents to LLMs for summarization and querying, with a simple GUI.
  ☆787Updated last year
• booydar / recurrent-memory-transformer
  [NeurIPS 22] [AAAI 24] Recurrent Transformer-based long-context architecture.
  ☆760Updated 4 months ago
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆585Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆706Updated last year
• shm007g / LLaMA-Cult-and-More
  Large Language Models for All, 🦙 Cult and More, Stay in touch !
  ☆441Updated last year
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆370Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 6 months ago
• zhudotexe / kani
  kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)
  ☆570Updated 2 weeks ago
• pHaeusler / micro-agent
  A tiny implementation of an autonomous agent powered by LLMs (OpenAI GPT-4)
  ☆443Updated last year
• kuleshov-group / llmtools
  Finetuning Large Language Models on One Consumer GPU in 2 Bits
  ☆719Updated 9 months ago
• plchld / InsightFlow
  LLM-based tool for parsing information and chatting with it
  ☆214Updated last year
• modal-labs / quillman
  A voice chat app
  ☆1,100Updated 3 months ago