premAI-io / serverless-examples
🚀 End-to-end examples and analysis of deploying LLMs serverless using Modal, Runpod, and Beam
☆27Updated 10 months ago
Alternatives and similar repositories for serverless-examples:
Users that are interested in serverless-examples are comparing it to the libraries listed below
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 2 months ago
- Build Agentic workflows with function calling using open LLMs☆26Updated 2 weeks ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 5 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆59Updated 3 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 7 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆64Updated 3 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆46Updated last month
- ☆48Updated last year
- BH hackathon☆14Updated 10 months ago
- Using modal.com to process FineWeb-edu data☆20Updated 2 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Simple AI agents / assistants☆41Updated 4 months ago
- ☆24Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆58Updated last month
- Set of scripts to finetune LLMs☆36Updated 10 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆79Updated 8 months ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆40Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Updated last year
- ☆111Updated last month
- alternative way to calculating self attention☆18Updated 8 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆100Updated 2 months ago
- Routing on Random Forest (RoRF)☆112Updated 4 months ago
- ☆32Updated last month
- ☆20Updated last year
- Ongoing research training transformer models at scale☆34Updated last year
- A miniature version of Modal☆19Updated 8 months ago
- This project breathes life into video characters by using AI to describe their personality and then chat with you as them.☆45Updated 11 months ago
- Streamlit app for recommending eval functions using prompt diffs☆27Updated last year