ray-project / llms-in-prod-workshop-2023Links
Deploy and Scale LLM-based applications
☆26Updated 2 years ago
Alternatives and similar repositories for llms-in-prod-workshop-2023
Users that are interested in llms-in-prod-workshop-2023 are comparing it to the libraries listed below
Sorting:
- Leverage your LangChain trace data for fine tuning☆42Updated last year
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated 2 years ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆120Updated this week
- Streamlit app for recommending eval functions using prompt diffs☆29Updated last year
- ☆79Updated last year
- ☆20Updated 9 months ago
- Chat Markup Language conversation library☆55Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- Verbosity control for AI agents☆64Updated last year
- Tutorial to get started with SkyPilot!☆58Updated last year
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Updated last year
- ☆87Updated last year
- Text to Python Objects via a LLM Function Call☆58Updated last year
- The backend behind the LLM-Perf Leaderboard☆10Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 2 months ago
- Tutorial and template for a semantic search app powered by the Atlas Embedding Database, Langchain, OpenAI and FastAPI☆115Updated last year
- Framework for building and maintaining self-updating prompts for LLMs☆64Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 10 months ago
- This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/☆41Updated last year
- A python package that provides a custom streamlit connection to query data from weaviate, the AI native vector database☆55Updated last year
- ☆29Updated 2 years ago
- Experimenting text-embeddings-inference server on both CPU and GPU☆18Updated last year
- ☆31Updated last year
- ☆61Updated 2 years ago
- ☆56Updated last month
- Adding NeMo Guardrails to a LlamaIndex RAG pipeline☆39Updated last year
- Voyage AI Official Python Library☆65Updated 2 weeks ago
- ☆12Updated last year