Alternatives and similar repositories for llm-hosting-container:

Users that are interested in llm-hosting-container are comparing it to the libraries listed below

• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆219Updated this week
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆137Updated last month
• aws-samples / llm-evaluation-methodology
  ☆40Updated 4 months ago
• cohere-ai / cohere-aws
  ☆61Updated last month
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆193Updated this week
• awslabs / extending-the-context-length-of-open-source-llms
  ☆51Updated 3 months ago
• aws-samples / aiml-genai-multimodal-agent
  ☆49Updated 10 months ago
• aws-samples / sagemaker-genai-hosting-examples
  ☆84Updated this week
• gilinachum / bedrock-latency
  Tools to measure latency for LLM in Amazon Bedrook
  ☆21Updated 2 weeks ago
• aws-samples / llm-apps-workshop
  Use LLMs for building real-world apps
  ☆111Updated last month
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆132Updated 2 weeks ago
• aws / sagemaker-huggingface-inference-toolkit
  ☆248Updated 4 months ago
• arunprsh / knowledge-augmented-LLMs
  Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment
  ☆32Updated last year
• aws-samples / amazon-sagemaker-generativeai
  Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…
  ☆141Updated last week
• aws-neuron / transformers-neuronx
  ☆102Updated last month
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆24Updated 3 months ago
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆137Updated 5 months ago
• aws-samples / generative-ai-financial-services-samples
  ☆50Updated this week
• aws-samples / AI-search-with-amazon-opensearch-service
  ☆48Updated this week
• aws-samples / Meta-Llama-on-AWS
  ☆74Updated last month
• aws-samples / text-to-sql-bedrock-workshop
  This repository is intended for those looking to dive deep on advanced Text-to-SQL concepts.
  ☆110Updated 2 weeks ago
• wenqiglantz / edd-recursive-doc-agent-vs-metadata-replacement
  Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines
  ☆31Updated last year
• aws-samples / sagemaker-hosting
  ☆43Updated 10 months ago
• aws-samples / fsi-genai-bootcamp
  ☆33Updated this week
• JGalego / RAGmap
  A simple Streamlit application that helps visualize document chunks and queries in embedding space 🗺️🔍
  ☆12Updated 6 months ago
• aws-samples / sagemaker-studio-docker-cli-extension
  SageMaker Studio Docker CLI Extension
  ☆13Updated 10 months ago
• aws-samples / foundation-model-benchmarking-tool
  Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…
  ☆228Updated this week
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆88Updated last year
• aws-samples / amazon-sagemaker-llm-fine-tuning-remote-decorator
  ☆53Updated last week