Run inference on MPT-30B using CPU
☆574Jun 30, 2023Updated 3 years ago
Alternatives and similar repositories for mpt-30B-inference
Users that are interested in mpt-30B-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run inference on replit-3B code instruct model using CPU☆160Jul 5, 2023Updated 3 years ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,887Jan 28, 2024Updated 2 years ago
- Chat with your data privately using MPT-30b☆183Jun 29, 2023Updated 3 years ago
- Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A☆971Nov 6, 2023Updated 2 years ago
- This is the official code for MobileSAM project that makes SAM lightweight for mobile applications and beyond!☆5,804May 5, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,483Jun 7, 2025Updated last year
- CodeTF: One-stop Transformer Library for State-of-the-art Code LLM☆1,479May 1, 2025Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆2,930Sep 30, 2023Updated 2 years ago
- Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend…☆1,937Mar 22, 2024Updated 2 years ago
- Salesforce open-source LLMs with 8k sequence length.☆727Jun 2, 2026Updated last month
- ☆133Nov 24, 2023Updated 2 years ago
- LLM as a Chatbot Service☆3,322Nov 20, 2023Updated 2 years ago
- ☆2,551Jan 7, 2025Updated last year
- Large Language Model Text Generation Inference☆10,864Mar 21, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset☆7,529Jul 16, 2023Updated 2 years ago
- Run evaluation on LLMs using human-eval benchmark☆429Sep 12, 2023Updated 2 years ago
- Locally hosted tool that connects documents to LLMs for summarization and querying, with a simple GUI.☆797Aug 1, 2023Updated 2 years ago
- H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/☆4,983Jun 30, 2026Updated last week
- prompt2model - Generate Deployable Models from Natural Language Instructions☆2,016Dec 29, 2024Updated last year
- Cross-Platform, GPU Accelerated Whisper 🏎️☆1,791Feb 27, 2024Updated 2 years ago
- LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transform…☆1,466Nov 7, 2023Updated 2 years ago
- LLMs custom-chatbots console ⚡☆5,238Feb 27, 2024Updated 2 years ago
- LOMO: LOw-Memory Optimization☆994Jul 2, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.☆3,867May 11, 2026Updated last month
- An Open-source Toolkit for LLM Development☆2,803Jan 13, 2025Updated last year
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,589Jul 29, 2025Updated 11 months ago
- LLaMA v2 Chatbot☆1,411Aug 27, 2023Updated 2 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,947Jun 10, 2024Updated 2 years ago
- Explore large language models in 512MB of RAM☆1,192Feb 19, 2026Updated 4 months ago
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,934Apr 13, 2026Updated 2 months ago
- An open source implementation of OpenAI's ChatGPT Code interpreter☆3,533Mar 20, 2024Updated 2 years ago
- ☆1,062May 29, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆10,259Sep 7, 2024Updated last year
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,381Jun 29, 2026Updated last week
- Universal LLM Deployment Engine with ML Compilation☆22,901Jun 30, 2026Updated last week
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,177Oct 8, 2024Updated last year
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,918Mar 14, 2024Updated 2 years ago
- Tensor library for machine learning☆14,935Jun 26, 2026Updated last week
- Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app …☆6,669Apr 11, 2026Updated 2 months ago