horosin / llm-on-aws-lambdaLinks
Code and instructions for deploying a smaller open-source Language Large Model (LLM) on AWS Lambda, using Python, Docker.
☆10Updated last year
Alternatives and similar repositories for llm-on-aws-lambda
Users that are interested in llm-on-aws-lambda are comparing it to the libraries listed below
Sorting:
- Pipeline is an open source python SDK for building AI/ML workflows☆138Updated last year
- An open-source cloud-native of large multi-modal models (LMMs) serving framework.☆165Updated 2 years ago
- A GitHub Action for installing and using Cog so you can run, test, and push machine learning models☆73Updated last year
- 💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client☆316Updated last year
- The Customer Care Bot is a cutting-edge customer support solution designed to revolutionize the way e-commerce websites interact with and…☆12Updated 2 years ago
- CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search☆66Updated 6 months ago
- LoRA inference model packaged with Cog☆74Updated 2 years ago
- Co-Coder is a Python package that streamlines error debugging from Open AI chat GPT and Google Bard by providing hints, example code, and…☆46Updated 2 years ago
- The power of a small LLM for your domain knowledge QnA☆25Updated 2 years ago
- ⚙️ | REPLACED BY https://github.com/runpod-workers | Official set of serverless worker provided by RunPod as endpoints.☆60Updated 7 months ago
- Create amazing Stable Diffusion prompts with minimal prompt knowledge. A vicuna based prompt engineering tool for stable diffusion☆91Updated 2 years ago
- PlayHT Python SDK - AI Text-to-Speech Streaming & Voice Cloning API☆220Updated this week
- A proposal for a structured LLM prompt method.☆56Updated 2 years ago
- A template to run LLaMA in Cog☆66Updated 2 years ago
- Inference of Large Multimodal Models in C/C++. LLaVA and others☆48Updated 2 years ago
- Example of calling OpenRouter from a Streamit app☆102Updated 2 years ago
- A cog implementation of MosaicML's MPT-7B-StoryWriter-65k+ Large Language Model☆58Updated 2 years ago
- ☆17Updated 2 years ago
- A library for defining AI personalities for AI based models.We define a file format, assets and personalized scripts.☆54Updated 2 years ago
- ☆50Updated 2 years ago
- Data Questionnaire Agent Chatbot☆71Updated last week
- 🐍 | Python library for RunPod API and serverless worker SDK.☆270Updated last week
- 🧑🎨 Stable Diffusion WebUI + ControlNet extension running in Docker. Built Docker image to be run as a Space at Hugging Face.☆33Updated 2 years ago
- Run OpenAI Whisper as a Cog model☆69Updated last year
- 🔓 The open-source autonomous agent LLM initiative 🔓☆91Updated last year
- Chat with your data privately using MPT-30b☆184Updated 2 years ago
- A curated list of amazing RunPod projects, libraries, and resources☆128Updated last year
- Python bindings for the C++ port of GPT4All-J model.☆37Updated 2 years ago
- A framework for building and testing custom autonomous agents.☆37Updated last year
- 😈 ImpAI is an advanced role play app using large language and diffusion models.☆64Updated last year