Alternatives and similar repositories for mpt-30B-inference

Users that are interested in mpt-30B-inference are comparing it to the libraries listed below

• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆455Updated 2 years ago
• freddyaboulton / gradio-tools
  ☆597Updated 2 years ago
• rlancemartin / auto-evaluator
  Evaluation tool for LLM QA chains
  ☆1,086Updated 2 years ago
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆822Updated 2 years ago
• jina-ai / agentchain
  Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks
  ☆605Updated 2 years ago
• paolorechia / learn-langchain
  ☆275Updated 2 years ago
• NouamaneTazi / bloomz.cpp
  C++ implementation for BLOOM
  ☆806Updated 2 years ago
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆411Updated 2 years ago
• Nuggt-dev / Nuggt
  An Autonomous LLM Agent that runs on Wizcoder-15B
  ☆333Updated last year
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆323Updated 2 years ago
• danielgross / LlamaAcademy
  A school for camelids
  ☆1,208Updated 2 years ago
• e-johnstonn / BriefGPT
  Locally hosted tool that connects documents to LLMs for summarization and querying, with a simple GUI.
  ☆797Updated 2 years ago
• scaleapi / llm-engine
  Scale LLM Engine public repository
  ☆814Updated this week
• plchld / InsightFlow
  LLM-based tool for parsing information and chatting with it
  ☆214Updated 2 years ago
• zhudotexe / kani
  kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
  ☆594Updated this week
• booydar / recurrent-memory-transformer
  [NeurIPS 22] [AAAI 24] Recurrent Transformer-based long-context architecture.
  ☆771Updated last year
• bborn / howdoi.ai
  howdoi.ai
  ☆256Updated 2 years ago
• modal-labs / quillman
  A voice chat app
  ☆1,172Updated 5 months ago
• zetavg / LLaMA-LoRA-Tuner
  UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT…
  ☆476Updated 2 years ago
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆372Updated 2 years ago
• genlayerlabs / yeagerai-agent
  ☆591Updated last year
• johnsmith0031 / alpaca_lora_4bit
  ☆534Updated last year
• pHaeusler / micro-agent
  A tiny implementation of an autonomous agent powered by LLMs (OpenAI GPT-4)
  ☆439Updated 2 years ago
• shm007g / LLaMA-Cult-and-More
  Large Language Models for All, 🦙 Cult and More, Stay in touch !
  ☆447Updated 2 years ago
• kuleshov-group / llmtools
  Finetuning Large Language Models on One Consumer GPU in 2 Bits
  ☆732Updated last year
• abacaj / replit-3B-inference
  Run inference on replit-3B code instruct model using CPU
  ☆159Updated 2 years ago
• BlackHC / llm-strategy
  Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types
  ☆398Updated 8 months ago
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆464Updated 2 years ago
• rogeriochaves / langstream
  Build robust LLM applications with true composability 🔗
  ☆421Updated last year
• abacaj / fine-tune-mistral
  Fine-tune mistral-7B on 3090s, a100s, h100s
  ☆714Updated 2 years ago