anyscale / e2e-llm-workflowsLinks
Fine-tune an LLM to perform batch inference and online serving.
☆115Updated 7 months ago
Alternatives and similar repositories for e2e-llm-workflows
Users that are interested in e2e-llm-workflows are comparing it to the libraries listed below
Sorting:
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆119Updated 9 months ago
- Multimodal AI workloads: batch inference, model training and online serving.☆105Updated 4 months ago
- Hugging Face Deep Learning Containers (DLCs) for Google Cloud☆162Updated last month
- 💻 Decoding ML articles hub: Hands-on articles with code on production-grade ML☆140Updated 10 months ago
- ☆80Updated last year
- Examples of using Evidently to evaluate, test and monitor ML models.☆47Updated 3 weeks ago
- zero-to-lightning☆31Updated last year
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆135Updated last year
- ☆147Updated last year
- Various installation guides for Large Language Models☆77Updated 8 months ago
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆113Updated last year
- Sample notebooks and prompts for LLM evaluation☆159Updated 2 months ago
- ☆89Updated 2 years ago
- [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs☆314Updated 6 months ago
- Starter pack for NeurIPS LLM Efficiency Challenge 2023.☆129Updated 2 years ago
- A template to kick-start your Python project ✨🚀☆53Updated 5 months ago
- Simple UI for debugging correlations of text embeddings☆306Updated 7 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Material for the series of seminars on Large Language Models☆34Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Updated last week
- Seemless interface of using PyTOrch distributed with Jupyter notebooks☆57Updated 3 months ago
- ☆15Updated 2 years ago
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆49Updated last year
- This repository will contain the presentation and python jupyter notebooks for the DataHack Summit 2024 conference talk, Improving Real-w…☆121Updated last year
- This playlab encompasses a multitude of projects crafted through the utilization of Large Language Models, showcasing the versatility and…☆145Updated last month
- Optimized Large Language Models for Financial Applications – Efficient, Scalable, and Domain-Specific AI for Finance.☆50Updated 6 months ago
- Build Agentic workflows with function calling using open LLMs☆28Updated last week
- GenAI Experimentation☆59Updated 4 months ago
- ☆19Updated last year