ray-project / llms-in-prod-workshop-2023Links
Deploy and Scale LLM-based applications
☆26Updated 2 years ago
Alternatives and similar repositories for llms-in-prod-workshop-2023
Users that are interested in llms-in-prod-workshop-2023 are comparing it to the libraries listed below
Sorting:
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- ☆80Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- A collection of examples demonstrating how to use dstack☆26Updated last year
- Leverage your LangChain trace data for fine tuning☆46Updated last year
- Tutorial to get started with SkyPilot!☆58Updated last year
- ☆21Updated last year
- Streamlit app for recommending eval functions using prompt diffs☆30Updated last year
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆130Updated last week
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆32Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- ☆41Updated last year
- Verbosity control for AI agents☆64Updated last year
- The backend behind the LLM-Perf Leaderboard☆11Updated last year
- ☆30Updated last year
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Chat Markup Language conversation library☆55Updated last year
- Large Language Model Hosting Container☆90Updated 2 months ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Updated 2 years ago
- Using modal.com to process FineWeb-edu data☆20Updated 8 months ago
- Example code using the DSPy framework.☆19Updated last year
- ☆56Updated 6 months ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Updated 2 months ago
- This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/☆41Updated last year
- Text to Python Objects via a LLM Function Call☆58Updated last year
- Knowledge Graph Generator app☆34Updated last year
- experiments with inference on llama☆103Updated last year
- ☆23Updated 2 years ago
- Example for Logging LLM Evaluator Prompt Responses☆18Updated 2 years ago
- Public reports detailing responses to sets of prompts by Large Language Models.☆32Updated 11 months ago