awslabs / llm-hosting-containerLinks
Large Language Model Hosting Container
☆90Updated 2 weeks ago
Alternatives and similar repositories for llm-hosting-container
Users that are interested in llm-hosting-container are comparing it to the libraries listed below
Sorting:
- ☆55Updated 4 months ago
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆245Updated last week
- ☆63Updated 6 months ago
- Leverage your LangChain trace data for fine tuning☆46Updated last year
- Streamlit app for recommending eval functions using prompt diffs☆29Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆113Updated 4 months ago
- ☆110Updated 9 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment☆31Updated 2 years ago
- Example code for AWS Neuron SDK developers building inference and training applications☆149Updated last week
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated 2 years ago
- ☆53Updated last year
- ☆268Updated 6 months ago
- ☆59Updated 10 months ago
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆124Updated this week
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- ☆45Updated 11 months ago
- The backend behind the LLM-Perf Leaderboard☆11Updated last year
- Just a bunch of benchmark logs for different LLMs☆118Updated last year
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆31Updated last year
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Updated 2 years ago
- Use LLMs for building real-world apps☆112Updated 9 months ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- Document Q&A on Wikipedia articles using LLMs☆79Updated 2 years ago
- experiments with inference on llama☆103Updated last year
- Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!☆173Updated last year
- Amazon SageMaker Managed Spot Training Examples☆50Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆50Updated last year
- Adding NeMo Guardrails to a LlamaIndex RAG pipeline☆41Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆58Updated 3 weeks ago