Alternatives and similar repositories for mpt-30B-inference:

Users that are interested in mpt-30B-inference are comparing it to the libraries listed below

• NouamaneTazi / bloomz.cpp
  C++ implementation for BLOOM
  ☆809Updated last year
• danielgross / LlamaAcademy
  A school for camelids
  ☆1,208Updated last year
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆820Updated last year
• freddyaboulton / gradio-tools
  ☆588Updated last year
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆371Updated last year
• salesforce / xgen
  Salesforce open-source LLMs with 8k sequence length.
  ☆716Updated last month
• zphang / minimal-llama
  ☆458Updated last year
• shm007g / LLaMA-Cult-and-More
  Large Language Models for All, 🦙 Cult and More, Stay in touch !
  ☆443Updated last year
• paolorechia / learn-langchain
  ☆276Updated last year
• BlackHC / llm-strategy
  Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types
  ☆395Updated 3 weeks ago
• e-johnstonn / BriefGPT
  Locally hosted tool that connects documents to LLMs for summarization and querying, with a simple GUI.
  ☆787Updated last year
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆584Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆311Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆709Updated last year
• rlancemartin / auto-evaluator
  Evaluation tool for LLM QA chains
  ☆1,072Updated last year
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆324Updated 2 years ago
• johnsmith0031 / alpaca_lora_4bit
  ☆535Updated last year
• kuleshov-group / llmtools
  Finetuning Large Language Models on One Consumer GPU in 2 Bits
  ☆720Updated 10 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆453Updated last year
• pointnetwork / point-alpaca
  ☆405Updated 2 years ago
• pHaeusler / micro-agent
  A tiny implementation of an autonomous agent powered by LLMs (OpenAI GPT-4)
  ☆443Updated last year
• radi-cho / datasetGPT
  A command-line interface to generate textual and conversational datasets with LLMs.
  ☆293Updated last year
• jina-ai / agentchain
  Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks
  ☆603Updated last year
• nomic-ai / pygpt4all
  Official supported Python bindings for llama.cpp + gpt4all
  ☆1,020Updated last year
• sahil280114 / codealpaca
  ☆1,462Updated last year
• modal-labs / quillman
  A voice chat app
  ☆1,105Updated 4 months ago
• jina-ai / thinkgpt
  Agent techniques to augment your LLM and push it beyong its limits
  ☆1,571Updated 10 months ago
• kennethleungty / Llama-2-Open-Source-LLM-CPU-Inference
  Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
  ☆961Updated last year
• Nuggt-dev / Nuggt
  An Autonomous LLM Agent that runs on Wizcoder-15B
  ☆336Updated 5 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆691Updated 11 months ago