ray-project / llms-in-prod-workshop-2023
Deploy and Scale LLM-based applications
☆26Updated last year
Alternatives and similar repositories for llms-in-prod-workshop-2023:
Users that are interested in llms-in-prod-workshop-2023 are comparing it to the libraries listed below
- ☆18Updated 4 months ago
- Streamlit app for recommending eval functions using prompt diffs☆27Updated last year
- Dynamic Metadata based RAG Framework☆71Updated 6 months ago
- ☆76Updated 8 months ago
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated last year
- Resources for exploring Generative Feedback Loops with Weaviate!☆36Updated last month
- End-to-End LLM Guide☆101Updated 7 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- A specification for OpenInference, a semantic mapping of ML inferences☆46Updated 10 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Experimenting text-embeddings-inference server on both CPU and GPU☆18Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated 10 months ago
- Run LLMs on Replicate with vLLM☆16Updated 4 months ago
- Example code using the DSPy framework.☆18Updated 8 months ago
- Chat Markup Language conversation library☆55Updated last year
- Running load tests on a FastAPI application using Locust☆12Updated 3 months ago
- Speech to Speech conversation using the OpenAI RealTime API in Python 🐍☆22Updated 3 months ago
- ☆29Updated last year
- Tutorial to get started with SkyPilot!☆56Updated 9 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆34Updated last year
- ☆69Updated 10 months ago
- Use sync mode Playwright interactively, inside a Jupyter notebook☆14Updated 2 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆29Updated 4 months ago
- Using modal.com to process FineWeb-edu data☆20Updated 2 months ago
- ☆88Updated last year
- Leverage your LangChain trace data for fine tuning☆41Updated 6 months ago
- ☆24Updated last year
- Tools for merging pretrained large language models.☆19Updated 8 months ago
- Writing Blog Posts with Generative Feedback Loops!☆47Updated 11 months ago