premAI-io / serverless-examples
🚀 End-to-end examples and analysis of deploying LLMs serverless using Modal, Runpod, and Beam
☆27Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for serverless-examples
- Using modal.com to process FineWeb-edu data☆19Updated 2 months ago
- Simple examples using Argilla tools to build AI☆40Updated this week
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 4 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆61Updated 2 weeks ago
- ☆18Updated this week
- Build Agentic workflows with function calling☆20Updated this week
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆20Updated 9 months ago
- BH hackathon☆14Updated 7 months ago
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…☆15Updated 2 months ago
- LlamaWorksDB is a Retrieval Augmented Generation (RAG) product designed to interact with the documentation of various products such as Ll…☆15Updated 6 months ago
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆58Updated 7 months ago
- OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…☆28Updated 11 months ago
- RAG example using DSPy, Gradio, FastAPI☆66Updated 7 months ago
- Testing the different LLM and RAG Tests while I learn along the way☆17Updated 2 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆53Updated 3 weeks ago
- ☆1Updated 4 months ago
- Apps that run on modal.com☆12Updated 5 months ago
- ☆64Updated 5 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated 10 months ago
- Set of scripts to finetune LLMs☆36Updated 7 months ago
- Data extraction with LLM on CPU☆66Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- Routing on Random Forest (RoRF)☆84Updated last month
- ☆20Updated 9 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆23Updated last week
- A Python library to orchestrate LLMs in a neural network-inspired structure☆41Updated last month
- Experimental Code for StructuredRAG: Structured Outputs in Retrieval-Augmented Generation☆94Updated this week
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆32Updated 6 months ago
- LLM reads a paper and produce a working prototype☆36Updated last week
- ☆48Updated last year