Run inference on MPT-30B using CPU
☆571Jun 30, 2023Updated 3 years ago
Alternatives and similar repositories for mpt-30B-inference
Users that are interested in mpt-30B-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,887Jan 28, 2024Updated 2 years ago
- Run inference on replit-3B code instruct model using CPU☆161Jul 5, 2023Updated 3 years ago
- LLM training code for Databricks foundation models☆4,462Mar 25, 2026Updated 7 months ago
- LLM as a Chatbot Service☆3,314Nov 20, 2023Updated 2 years ago
- LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transform…☆1,462Nov 7, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A☆970Nov 6, 2023Updated 3 years ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,472Jun 7, 2025Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,946Sep 30, 2023Updated 3 years ago
- Chat with your data privately using MPT-30b☆184Jun 29, 2023Updated 3 years ago
- CodeTF: One-stop Transformer Library for State-of-the-art Code LLM☆1,476May 1, 2025Updated last year
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,519Jul 16, 2023Updated 3 years ago
- ☆2,540Jan 7, 2025Updated last year
- This is the official code for MobileSAM project that makes SAM lightweight for mobile applications and beyond!☆5,911May 5, 2026Updated 6 months ago
- Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend…☆1,932Mar 22, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Salesforce open-source LLMs with 8k sequence length.☆727Jun 2, 2026Updated 5 months ago
- Large Language Model Text Generation Inference☆10,882Mar 21, 2026Updated 7 months ago
- ☆1,068May 29, 2023Updated 3 years ago
- LLMs custom-chatbots console ⚡☆5,225Feb 27, 2024Updated 2 years ago
- FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.☆3,867Jul 13, 2026Updated 3 months ago
- prompt2model - Generate Deployable Models from Natural Language Instructions☆2,022Dec 29, 2024Updated last year
- An Open-source Toolkit for LLM Development☆2,797Jan 13, 2025Updated last year
- Locally hosted tool that connects documents to LLMs for summarization and querying, with a simple GUI.☆795Aug 1, 2023Updated 3 years ago
- H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/☆5,193Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An open source implementation of OpenAI's ChatGPT Code interpreter☆3,529Mar 20, 2024Updated 2 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11,066Jun 10, 2024Updated 2 years ago
- LOMO: LOw-Memory Optimization☆992Jul 2, 2024Updated 2 years ago
- Run evaluation on LLMs using human-eval benchmark☆432Sep 12, 2023Updated 3 years ago
- Python package for easily interfacing with chat apps, with robust features and minimal code complexity.☆3,489Jul 3, 2024Updated 2 years ago
- Scale LLM Engine public repository☆840Updated this week
- Cross-Platform, GPU Accelerated Whisper 🏎️☆1,794Feb 27, 2024Updated 2 years ago
- Universal LLM Deployment Engine with ML Compilation☆23,308Oct 30, 2026Updated last week
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,174Oct 8, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆13,061Oct 17, 2026Updated 3 weeks ago
- LLaMA v2 Chatbot☆1,407Aug 27, 2023Updated 3 years ago
- ☆133Nov 24, 2023Updated 2 years ago
- Explore large language models in 512MB of RAM☆1,187Feb 19, 2026Updated 8 months ago
- Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. D…☆11,927Oct 9, 2025Updated last year
- OpenChat: Advancing Open-source Language Models with Imperfect Data☆5,477Sep 13, 2024Updated 2 years ago
- 📋 A list of open LLMs available for commercial use.☆12,883Feb 13, 2025Updated last year