ray-project / llms-in-prod-workshop-2023Links
Deploy and Scale LLM-based applications
☆26Updated 2 years ago
Alternatives and similar repositories for llms-in-prod-workshop-2023
Users that are interested in llms-in-prod-workshop-2023 are comparing it to the libraries listed below
Sorting:
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆36Updated 2 years ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Example for Logging LLM Evaluator Prompt Responses☆18Updated 2 years ago
- This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/☆41Updated 2 years ago
- Leverage your LangChain trace data for fine tuning☆46Updated last year
- Tutorial to get started with SkyPilot!☆58Updated last year
- Sentence Embedding as a Service☆15Updated 6 months ago
- A collection of examples demonstrating how to use dstack☆26Updated last year
- Text to Python Objects via a LLM Function Call☆58Updated last year
- Tutorial and template for a semantic search app powered by the Atlas Embedding Database, Langchain, OpenAI and FastAPI☆113Updated 2 years ago
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆133Updated this week
- ☆89Updated 2 years ago
- A python package that provides a custom streamlit connection to query data from weaviate, the AI native vector database☆57Updated last year
- ☆80Updated last year
- ☆21Updated last year
- Chat Markup Language conversation library☆55Updated 2 years ago
- Large Language Model Hosting Container☆91Updated 3 months ago
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated 2 years ago
- Framework for building and maintaining self-updating prompts for LLMs☆65Updated last year
- ☆56Updated 6 months ago
- The backend behind the LLM-Perf Leaderboard☆11Updated last year
- ☆30Updated last year
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆26Updated 10 months ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Updated 2 years ago
- ☆41Updated last year
- Streamlit app for recommending eval functions using prompt diffs☆30Updated 2 years ago
- A tutorial for building autonomous agents: with LangChain and from scratch☆31Updated 2 years ago
- 🤖 AI Assistant fine-tuned to provide support for coding and design questions based on the latest trends in the industry.☆17Updated 2 years ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆32Updated last year