Alternatives and similar repositories for llm-hosting-container:

Users that are interested in llm-hosting-container are comparing it to the libraries listed below

• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆216Updated this week
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆132Updated 2 weeks ago
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆160Updated last month
• cohere-ai / cohere-aws
  ☆60Updated last month
• aws-samples / fsi-genai-bootcamp
  ☆33Updated 2 months ago
• awslabs / extending-the-context-length-of-open-source-llms
  ☆51Updated last month
• aws-samples / llm-evaluation-methodology
  ☆40Updated 3 months ago
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆22Updated 9 months ago
• aws-samples / awsome-inference
  ☆38Updated this week
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆136Updated 3 months ago
• aws-neuron / transformers-neuronx
  ☆102Updated 2 weeks ago
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆130Updated 2 months ago
• aws-samples / mlops-e2e
  MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK
  ☆135Updated last month
• aws-samples / llm-apps-workshop
  Use LLMs for building real-world apps
  ☆111Updated 2 weeks ago
• aws-samples / sagemaker-vector-store-microservice
  ☆21Updated last year
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆88Updated last year
• aws / fmeval
  Foundation Model Evaluations Library
  ☆227Updated 2 weeks ago
• awslabs / aiops-modules
  AIOps modules is a collection of reusable Infrastructure as Code (IaC) modules for Machine Learning (ML), Foundation Models (FM), Large L…
  ☆65Updated this week
• aws-samples / aws-do-kubeflow
  A do-framework project to simplify deployment of Kubeflow on Amazon EKS
  ☆20Updated 2 weeks ago
• wenqiglantz / edd-recursive-doc-agent-vs-metadata-replacement
  Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines
  ☆31Updated last year
• aws-samples / aws-samples-for-ray
  ☆66Updated 7 months ago
• aws-samples / foundation-model-benchmarking-tool
  Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…
  ☆220Updated this week
• JGalego / RAGmap
  A simple Streamlit application that helps visualize document chunks and queries in embedding space 🗺️🔍
  ☆12Updated 5 months ago
• aws-samples / text-to-sql-bedrock-workshop
  This repository is intended for those looking to dive deep on advanced Text-to-SQL concepts.
  ☆99Updated 2 months ago
• aws / sagemaker-huggingface-inference-toolkit
  ☆243Updated 3 months ago
• aws-samples / aws-genai-conversational-rag-reference
  AWS Generative AI Conversational RAG Reference (Galileo)
  ☆73Updated 3 weeks ago
• aws-samples / amazon-sagemaker-personalized-generative-ai
  This project simplifies personalized Gen-AI SaaS apps. We fine-tune pre-trained models for users, use single GPUs, and ensure real-time r…
  ☆20Updated last year
• build-on-aws / bedrock-agent-txt2sql
  Use natural language to Generate Amazon Athena SQL queries to fetch data.
  ☆59Updated 2 months ago
• philschmid / cdk-samples
  ☆57Updated 2 years ago
• arunprsh / knowledge-augmented-LLMs
  Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment
  ☆32Updated last year