ray-project / llms-in-prod-workshop-2023Links
Deploy and Scale LLM-based applications
☆26Updated 2 years ago
Alternatives and similar repositories for llms-in-prod-workshop-2023
Users that are interested in llms-in-prod-workshop-2023 are comparing it to the libraries listed below
Sorting:
- Tutorial to get started with SkyPilot!☆58Updated last year
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆124Updated this week
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated 2 years ago
- Verbosity control for AI agents☆65Updated last year
- Streamlit app for recommending eval functions using prompt diffs☆29Updated last year
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Leverage your LangChain trace data for fine tuning☆44Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated 4 months ago
- Chat Markup Language conversation library☆55Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- This repository contains the source code for running llamaindex tutorials from https://howaibuildthis.substack.com/☆41Updated last year
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Updated last year
- ☆31Updated last year
- ☆56Updated 2 months ago
- Explore new advancements like ChatGPT’s function calling capability, and build a conversational agent using a new syntax called LangChain…☆15Updated last year
- ☆80Updated last year
- ☆20Updated 10 months ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 11 months ago
- The backend behind the LLM-Perf Leaderboard☆10Updated last year
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated last year
- A collection of examples demonstrating how to use dstack☆26Updated last year
- ☆20Updated 5 months ago
- A python package that provides a custom streamlit connection to query data from weaviate, the AI native vector database☆55Updated last year
- Text to Python Objects via a LLM Function Call☆58Updated last year
- A Discord Bot for distilling papers, GitHub repos, Blogposts, and much more using the power of LLMs and vector search.☆13Updated 2 years ago
- Writing Blog Posts with Generative Feedback Loops!☆50Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 3 months ago
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆24Updated 5 months ago
- Chrome Extension for exploring Hugging Face datasets 🔎☆50Updated 11 months ago
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 2 months ago