ray-project / llms-in-prod-workshop-2023Links
Deploy and Scale LLM-based applications
☆26Updated 2 years ago
Alternatives and similar repositories for llms-in-prod-workshop-2023
Users that are interested in llms-in-prod-workshop-2023 are comparing it to the libraries listed below
Sorting:
- A framework for simulating e-commerce data and interactions that can be used to build recommendation systems☆10Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated 2 years ago
- ☆77Updated last year
- Tutorial to get started with SkyPilot!☆58Updated last year
- Streamlit app for recommending eval functions using prompt diffs☆28Updated last year
- Leverage your LangChain trace data for fine tuning☆41Updated 11 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated last year
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆117Updated last week
- ☆31Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Example for Logging LLM Evaluator Prompt Responses☆17Updated last year
- Text to Python Objects via a LLM Function Call☆58Updated last year
- ☆20Updated 9 months ago
- A collection of examples demonstrating how to use dstack☆26Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated last month
- ☆23Updated 2 years ago
- ChatBot App built using LangChain and Lightning AI☆18Updated 2 years ago
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated last year
- Large Language Model Hosting Container☆89Updated 2 weeks ago
- 🤝 Trade any tensors over the network☆30Updated last year
- A specification for OpenInference, a semantic mapping of ML inferences☆47Updated last year
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆37Updated last year
- Tool to take your ML model from local to production with one-line of code.☆25Updated last year
- ☆12Updated last year
- An LLM-powered Streamlit chatbot for data exploration and question answering on Snowflake☆128Updated last year
- Research notes and extra resources for all the work at explodinggradients.com☆23Updated 4 months ago
- Writing Blog Posts with Generative Feedback Loops!☆49Updated last year
- This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/☆41Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- Data extraction with LLM on CPU☆68Updated last year