aws-samples / zero-administration-inference-with-aws-lambda-for-hugging-face

Related projects: ⓘ

• aws / sagemaker-huggingface-inference-toolkit
  ☆235Updated 3 weeks ago
• arunprsh / knowledge-augmented-LLMs
  Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment
  ☆31Updated last year
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆134Updated 3 months ago
• awslabs / sagemaker-dashboards-for-ml
  ☆91Updated 3 years ago
• aws-samples / lambda-serverless-inference-fastapi
  ☆30Updated 7 months ago
• philschmid / cdk-samples
  ☆57Updated 2 years ago
• aws-samples / amazon-sagemaker-codeserver
  Hosting code-server on Amazon SageMaker
  ☆50Updated 11 months ago
• aws-samples / amazon-textract-transformer-pipeline
  Post-process Amazon Textract results with Hugging Face transformer models for document understanding
  ☆92Updated last month
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆193Updated this week
• aws-samples / aws-serverless-for-machine-learning-inference
  This is a sample solution for bringing your own ML models and inference code, and running them at scale using AWS serverless services.
  ☆34Updated 9 months ago
• aws / fmeval
  Foundation Model Evaluations Library
  ☆184Updated 3 weeks ago
• aws-samples / semantic-search-with-amazon-opensearch
  ☆103Updated this week
• aws-samples / amazon-sagemaker-bert-classify-pytorch
  This sample show you how to train BERT on Amazon Sagemaker using Spot instances
  ☆31Updated 8 months ago
• aws-samples / aws-lambda-docker-serverless-inference
  Serve scikit-learn, XGBoost, TensorFlow, and PyTorch models with AWS Lambda container images support.
  ☆95Updated last month
• baileytec-labs / llama-on-lambda
  Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!
  ☆165Updated 5 months ago
• aws-samples / question-answering-large-documents
  ☆21Updated 2 weeks ago
• aws-samples / easy-amazon-sagemaker-deployments
  SageMaker custom deployments made easy
  ☆56Updated 8 months ago
• philschmid / terraform-aws-sagemaker-huggingface
  ☆46Updated 6 months ago
• aws-samples / sagemaker-hosting
  ☆41Updated 4 months ago
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆86Updated last year
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆86Updated 3 weeks ago
• aws-samples / llm-apps-workshop
  Use LLMs for building real-world apps
  ☆107Updated 6 months ago
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆217Updated last week
• aws-samples / serverless-rag-demo
  Amazon Bedrock Anthropic Claude, (Llama2-7B/13B/70B /Falcon-7B/40B/180B on Amazon Sagemaker) LLMs with Amazon Opensearch Serverless as a …
  ☆139Updated last week
• cohere-ai / cohere-aws
  ☆56Updated this week
• aws-samples / generative-ai-workshop-build-a-multifunctional-chatbot-on-sagemaker
  ☆41Updated 6 months ago
• aws-samples / conversational-ai-llms-with-amazon-lex-and-sagemaker
  ☆30Updated 10 months ago
• aws-samples / sagemaker-studio-lifecycle-config-examples
  ☆78Updated 4 months ago
• aws-samples / aws-genai-conversational-rag-reference
  AWS Generative AI Conversational RAG Reference (Galileo)
  ☆71Updated 2 weeks ago
• aws-samples / sagemaker-studio-image-build-cli
  CLI for building Docker images in SageMaker Studio using AWS CodeBuild.
  ☆57Updated 2 years ago