Alternatives and similar repositories for llm-hosting-container

Users that are interested in llm-hosting-container are comparing it to the libraries listed below

• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆230Updated this week
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆149Updated 2 weeks ago
• wenqiglantz / edd-recursive-doc-agent-vs-metadata-replacement
  Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines
  ☆31Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆54Updated 6 months ago
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆141Updated 8 months ago
• cohere-ai / cohere-aws
  ☆62Updated 2 months ago
• aws-samples / aws-samples-for-ray
  ☆72Updated last year
• aws / sagemaker-huggingface-inference-toolkit
  ☆263Updated 2 months ago
• aws-samples / llm-evaluation-methodology
  ☆44Updated 7 months ago
• aws-samples / aiml-genai-multimodal-agent
  ☆54Updated last year
• arunprsh / knowledge-augmented-LLMs
  Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment
  ☆32Updated last year
• aws-neuron / aws-neuron-eks-samples
  ☆24Updated 3 weeks ago
• aws-neuron / transformers-neuronx
  ☆110Updated 5 months ago
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆78Updated 4 months ago
• aws-samples / sagemaker-studio-docker-cli-extension
  SageMaker Studio Docker CLI Extension
  ☆13Updated last year
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆41Updated 10 months ago
• aws-samples / awsome-inference
  ☆47Updated last month
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆141Updated 3 weeks ago
• aws-samples / llm-apps-workshop
  Use LLMs for building real-world apps
  ☆113Updated 5 months ago
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆254Updated 2 months ago
• aws / fmeval
  Foundation Model Evaluations Library
  ☆256Updated 2 months ago
• aws-samples / build-an-automated-large-language-model-evaluation-pipeline-on-aws
  ☆40Updated last month
• philschmid / terraform-aws-sagemaker-huggingface
  ☆49Updated last year
• aws-samples / sagemaker-hosting
  ☆44Updated last year
• hamelsmu / ft-drift
  Check for data drift between two OpenAI multi-turn chat jsonl files.
  ☆37Updated last year
• baileytec-labs / llama-on-lambda
  Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!
  ☆174Updated last year
• aws-samples / rag-with-amazon-opensearch-and-sagemaker
  Question Answering Generative AI application with Large Language Models (LLMs) and Amazon OpenSearch Service
  ☆25Updated 6 months ago
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆88Updated last year
• aws-samples / sagemaker-genai-hosting-examples
  ☆104Updated this week
• aws-samples / llm-gateway
  ☆26Updated 4 months ago