sofianhamiti / amazon-ecs-nvidia-triton-cdk

Related projects: ⓘ

• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆16Updated last year
• allenai / cached_path
  A file utility for accessing both local and remote files through a unified interface.
  ☆36Updated last month
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆21Updated 5 months ago
• brentley / tensorflow-container
  Example code for deploying GPU workloads on ECS
  ☆19Updated 5 years ago
• philschmid / terraform-aws-sagemaker-huggingface
  ☆46Updated 6 months ago
• sblakey / llm-bedrock-anthropic
  Plugin for https://llm.datasette.io/en/stable/ to enable talking with Claude Instant and ClaudeV2 models on AWS Bedrock
  ☆30Updated 2 weeks ago
• Alignment-Lab-AI / datagen
  a pipeline for using api calls to agnostically convert unstructured data into structured training data
  ☆26Updated last year
• truskovskiyk / pr-reviewer
  Use LLM to help you with PR review
  ☆67Updated last year
• awslabs / extending-the-context-length-of-open-source-llms
  ☆47Updated 3 weeks ago
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆193Updated this week
• aws-neuron / transformers-neuronx
  ☆94Updated this week
• zjohn77 / lightning-mlflow-hf
  Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow
  ☆55Updated 10 months ago
• CarperAI / squeakily
  A library for squeakily cleaning and filtering language datasets.
  ☆45Updated last year
• axiomic-ai / axiomic
  Creating Generative AI Apps which work
  ☆16Updated 2 months ago
• neuralwork / instruct-finetune-mistral
  Fine-tune Mistral 7B to generate fashion style suggestions
  ☆30Updated 8 months ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆75Updated 2 weeks ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆82Updated 6 months ago
• bentoml / aws-lambda-deploy
  Fast model deployment on AWS Lambda
  ☆14Updated 6 months ago
• rwightman / genalog
  Genalog is an open source, cross-platform python package allowing generation of synthetic document images with custom degradations and te…
  ☆42Updated 8 months ago
• aws-neuron / aws-neuron-eks-samples
  ☆14Updated 5 months ago
• philschmid / cdk-samples
  ☆57Updated 2 years ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆51Updated last week
• aws-samples / training-llm-on-sagemaker-for-multiple-nodes-with-deepspeed
  ☆23Updated 6 months ago
• outerbounds / metaflow-ray
  ☆20Updated 10 months ago
• rom1504 / gpu-tester
  gpu tester detects broken and slow gpus in a cluster
  ☆63Updated last year
• cohere-ai / cohere-aws
  ☆56Updated this week
• PrithivirajDamodaran / SPLADERunner
  Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…
  ☆27Updated 3 weeks ago
• philschmid / serverless-machine-learning
  collection of serverless machine learning use cases and examples including Hugging Face transformers, timm, Gradio
  ☆14Updated last year
• bentoml / aws-ec2-deploy
  Fast model deployment on AWS EC2
  ☆14Updated 6 months ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆13Updated 8 months ago