premAI-io / serverless-examples
🚀 End-to-end examples and analysis of deploying LLMs serverless using Modal, Runpod, and Beam
☆27Updated 10 months ago
Alternatives and similar repositories for serverless-examples:
Users that are interested in serverless-examples are comparing it to the libraries listed below
- BH hackathon☆14Updated 9 months ago
- ☆65Updated 8 months ago
- ☆109Updated last month
- ☆29Updated 10 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆63Updated 2 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 6 months ago
- Using modal.com to process FineWeb-edu data☆19Updated last month
- Easy to use, High Performant Knowledge Distillation for LLMs☆40Updated 3 weeks ago
- Example code using the DSPy framework.☆18Updated 8 months ago
- Routing on Random Forest (RoRF)☆100Updated 4 months ago
- Simple examples using Argilla tools to build AI☆52Updated 2 months ago
- Official homepage for "Self-Harmonized Chain of Thought"☆89Updated last week
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆18Updated 3 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆56Updated 3 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated 9 months ago
- Fun project: LLM powered RAG Discord Bot that works seamlessly on CPU☆32Updated last year
- Set of scripts to finetune LLMs☆36Updated 10 months ago
- Verbosity control for AI agents☆59Updated 8 months ago
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…☆19Updated 4 months ago
- Streamlit app for recommending eval functions using prompt diffs☆27Updated last year
- Embed anything.☆28Updated 8 months ago
- ☆48Updated last year
- ☆20Updated last year
- LlamaWorksDB is a Retrieval Augmented Generation (RAG) product designed to interact with the documentation of various products such as Ll…☆15Updated 8 months ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆100Updated last month
- Build Agentic workflows with function calling☆26Updated 2 weeks ago
- ☆17Updated 2 weeks ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆58Updated 6 months ago
- Text to Python Objects via a LLM Function Call☆56Updated 10 months ago