premAI-io / serverless-examplesLinks
🚀 End-to-end examples and analysis of deploying LLMs serverless using Modal, Runpod, and Beam
☆28Updated last year
Alternatives and similar repositories for serverless-examples
Users that are interested in serverless-examples are comparing it to the libraries listed below
Sorting:
- Cerule - A Tiny Mighty Vision Model☆68Updated last month
- ☆118Updated last year
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆85Updated last year
- ☆51Updated 2 years ago
- BH hackathon☆14Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Updated 2 months ago
- Build Agentic workflows with function calling using open LLMs☆28Updated last month
- A miniature version of Modal☆22Updated last year
- ☆64Updated last year
- ☆20Updated last year
- ☆68Updated last year
- ☆28Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- inference code for mixtral-8x7b-32kseqlen☆104Updated 2 years ago
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- ☆122Updated last year
- GRDN.AI app for garden optimization☆69Updated last month
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆69Updated last month
- Using modal.com to process FineWeb-edu data☆20Updated 8 months ago
- Simple AI agents / assistants☆51Updated last year
- A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…☆59Updated last year
- alternative way to calculating self attention☆18Updated last year
- Verbosity control for AI agents☆64Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Gradio UI for a Cog API☆71Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- Apps that run on modal.com☆12Updated 3 months ago
- ☆31Updated 11 months ago
- ☆55Updated 3 months ago
- A new benchmark for measuring LLM's capability to detect bugs in large codebase.☆32Updated last year