☆50Oct 10, 2023Updated 2 years ago
Alternatives and similar repositories for exllama-runpod-serverless
Users that are interested in exllama-runpod-serverless are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆53Jun 11, 2023Updated 3 years ago
- TheBloke's Dockerfiles☆310Mar 8, 2024Updated 2 years ago
- The Runpod worker template for serving our large language model endpoints. Powered by vLLM.☆465Updated this week
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆11Feb 11, 2024Updated 2 years ago
- ⚙️ | REPLACED BY https://github.com/runpod-workers | Official set of serverless worker provided by Runpod as endpoints.☆61Jul 17, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- RunPod Serverless Worker for the Automatic1111 Stable Diffusion API☆16Feb 16, 2026Updated 6 months ago
- Turns KoboldAI into a crowdsourced distributed cluster☆34Oct 19, 2023Updated 2 years ago
- Automatic1111 serverless worker.☆99Nov 21, 2025Updated 9 months ago
- ☆19Dec 2, 2025Updated 8 months ago
- This repository contains a Python implementation that allows you to use gorilla-llm/gorilla-openfunctions-v2 LLM to perform function call…☆17Apr 7, 2024Updated 2 years ago
- 🐍 | Python library for Runpod API and serverless worker SDK.☆309Updated this week
- ☆16Feb 15, 2023Updated 3 years ago
- Codebase for fine-tuning Llama2 70B to generate math test questions and answers.☆10Aug 30, 2024Updated last year
- An application that helps you summarize your meetings in real time using OpenAI's ChatGPT APIs.☆12Mar 14, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆16Jul 12, 2024Updated 2 years ago
- Opinionated Langchain setup with Qdrant vector store and Kong gateway☆32Apr 7, 2023Updated 3 years ago
- ☆13Dec 13, 2023Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆12Nov 27, 2023Updated 2 years ago
- WWDC slackbot in Golang for http://asciiwwdc.com☆11Apr 21, 2016Updated 10 years ago
- ☆15Nov 13, 2023Updated 2 years ago
- Immersed boundary fractional step method written in FORTRAN 90☆16Aug 14, 2012Updated 14 years ago
- This repository contains the code snippets used in "LLM Prompt Engineering For Developers"☆14Apr 22, 2024Updated 2 years ago
- Running Ollama with Runpod☆66Jul 26, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Iowa House Prices Kaggle (top 5%)☆15Jun 17, 2024Updated 2 years ago
- ☆28Jul 25, 2023Updated 3 years ago
- 对话集提取器是一个基于chatglm模型的工具，用于从文本中提取对话集。该工具可以帮助用户从小说、剧本等文本中自动提取出对话，以便进行分析、标注或其他应用。☆12Nov 22, 2024Updated last year
- a cli/mcp server tool for managing mcp server json config file with version control, profiles and multi-client support☆10Feb 24, 2025Updated last year
- Fixed-radius near neighbors search algorithm implemented in Python using Numba and Numpy for performance.☆13Apr 13, 2026Updated 4 months ago
- An unofficial implementation of Custom Diffusion for Automatic1111's WebUI.☆68Jul 17, 2023Updated 3 years ago
- 用RLHF可选LoRA对LLaMA和MOSS进行训练|Training LLaMA or MOSS with RLHF [LoRA]☆21May 16, 2023Updated 3 years ago
- Pytorch directly integrated to the cloud all through Bench AI!☆10Dec 10, 2023Updated 2 years ago
- LMQL implementation of tree of thoughts☆36Jan 31, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Radial Distribution Function(rdf) 镜像分布函数计算☆15Nov 29, 2020Updated 5 years ago
- doug is an ai experiment with openai, llama-cpp-python, and langchain☆16Sep 2, 2025Updated 11 months ago
- 🐳 | Dockerfiles for the Runpod container images used for our official templates.☆234Updated this week
- AI QA interface to your obsidian notes☆18May 31, 2023Updated 3 years ago
- Vectorstores is a framework for using vector databases in your AI applications☆17Mar 16, 2026Updated 5 months ago
- Genie in the Box: Distill Whisper STT => Mistral-7B => Phind/Phind-CodeLlama-34B-v2 => GPT 3.5 => Coqui's TTS/OpenAI TTS☆15Apr 24, 2024Updated 2 years ago
- 2D LBM channel flow simulation with particle interaction.☆13Apr 16, 2022Updated 4 years ago