ray-project / llms-in-prod-workshop-2023
Deploy and Scale LLM-based applications
☆26Updated last year
Related projects ⓘ
Alternatives and complementary repositories for llms-in-prod-workshop-2023
- End-to-End LLM Guide☆97Updated 4 months ago
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆36Updated 7 months ago
- Self-host LLMs with vLLM and BentoML☆74Updated last week
- Streamlit app for recommending eval functions using prompt diffs☆25Updated 10 months ago
- ☆15Updated last month
- ☆31Updated 8 months ago
- Large Language Model Hosting Container☆78Updated 3 weeks ago
- A collection of examples demonstrating how to use dstack☆27Updated 5 months ago
- ☆18Updated this week
- Explore the use of DSPy for extracting features from PDFs 🔎☆33Updated 8 months ago
- Tutorial to get started with SkyPilot!☆56Updated 6 months ago
- Build Agentic workflows with function calling☆20Updated this week
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 10 months ago
- Repository containing awesome resources regarding Hugging Face tooling.☆43Updated 10 months ago
- Runner in charge of collecting metrics from LLM inference endpoints for the Unify Hub☆17Updated 9 months ago
- ChatBot App built using LangChain and Lightning AI☆17Updated last year
- ☆15Updated 5 months ago
- Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.☆50Updated 8 months ago
- Use Grounding DINO, Segment Anything, and CLIP to label objects in images.☆23Updated 10 months ago
- ☆12Updated 7 months ago
- This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/☆38Updated 10 months ago
- ☆24Updated last year
- Collection of recipes aiding Gen AI model development☆88Updated last week
- Low latency, High Accuracy, Custom Query routers for Co-pilots and Agents. Built by Prithivi Da☆31Updated this week
- Tool to take your ML model from local to production with one-line of code.☆23Updated 10 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆28Updated 2 months ago
- Using modal.com to process FineWeb-edu data☆19Updated 2 months ago
- A framework for simulating e-commerce data and interactions that can be used to build recommendation systems☆10Updated 11 months ago
- ☆1Updated 4 months ago