awslabs / llm-hosting-containerLinks
Large Language Model Hosting Container
☆91Updated 2 weeks ago
Alternatives and similar repositories for llm-hosting-container
Users that are interested in llm-hosting-container are comparing it to the libraries listed below
Sorting:
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆236Updated last week
- ☆56Updated 2 months ago
- ☆62Updated 4 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆147Updated this week
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Updated last year
- Fine-tune an LLM to perform batch inference and online serving.☆112Updated 2 months ago
- ☆113Updated 7 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment☆32Updated 2 years ago
- 💙 Unstructured Data Connectors for Haystack 2.0☆17Updated last year
- Streamlit app for recommending eval functions using prompt diffs☆29Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- experiments with inference on llama☆104Updated last year
- Leverage your LangChain trace data for fine tuning☆44Updated last year
- Evaluation of bm42 sparse indexing algorithm☆68Updated last year
- Repository containing awesome resources regarding Hugging Face tooling.☆48Updated last year
- Just a bunch of benchmark logs for different LLMs☆120Updated last year
- ☆54Updated last year
- Amazon SageMaker Managed Spot Training Examples☆51Updated last year
- Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.☆124Updated this week
- ☆87Updated last year
- ☆80Updated last year
- ☆63Updated 5 months ago
- ☆44Updated 9 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- ☆145Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Updated last month
- Tutorial to get started with SkyPilot!☆58Updated last year
- ☆19Updated 7 months ago