ray-project / llms-in-prod-workshop-2023Links
Deploy and Scale LLM-based applications
☆26Updated 2 years ago
Alternatives and similar repositories for llms-in-prod-workshop-2023
Users that are interested in llms-in-prod-workshop-2023 are comparing it to the libraries listed below
Sorting:
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆129Updated this week
- Leverage your LangChain trace data for fine tuning☆46Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Tutorial to get started with SkyPilot!☆58Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- Streamlit app for recommending eval functions using prompt diffs☆30Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆32Updated last year
- A collection of examples demonstrating how to use dstack☆26Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Updated 2 years ago
- ☆40Updated last year
- This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/☆41Updated last year
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated 2 years ago
- Text to Python Objects via a LLM Function Call☆58Updated last year
- ☆80Updated last year
- Chat Markup Language conversation library☆55Updated last year
- ☆30Updated last year
- Verbosity control for AI agents☆64Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Updated 2 months ago
- Product analytics for AI Assistants☆155Updated 6 months ago
- ☆21Updated last year
- Chrome Extension for exploring Hugging Face datasets 🔎☆49Updated last year
- Large Language Model Hosting Container☆90Updated 2 months ago
- Experimenting text-embeddings-inference server on both CPU and GPU☆18Updated 2 years ago
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆114Updated 6 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Updated 2 months ago
- Knowledge Graph Generator app☆34Updated last year
- Framework for building and maintaining self-updating prompts for LLMs☆64Updated last year
- Data extraction with LLM on CPU☆85Updated 2 years ago