triton-inference-server / fil_backend

Related projects ⓘ

Alternatives and complementary repositories for fil_backend

• NVIDIA-Merlin / systems
  Merlin Systems provides tools for combining recommendation models with other elements of production recommender systems (like feature sto…
  ☆90Updated 5 months ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆185Updated 2 months ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆133Updated this week
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆66Updated last year
• triton-inference-server / hugectr_backend
  ☆51Updated last year
• sdpython / mlprodict
  Productionize machine learning predictions, with ONNX or without
  ☆66Updated 10 months ago
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆144Updated 4 months ago
• rapidsai / gpu-bdb
  RAPIDS GPU-BDB
  ☆107Updated 8 months ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆42Updated 2 years ago
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆434Updated this week
• kubeflow / xgboost-operator
  Incubating project for xgboost operator
  ☆76Updated 2 years ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆127Updated this week
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆106Updated last year
• criteo / deepr
  The deepr module provide abstractions (layers, readers, prepro, metrics, config) to help build tensorflow models on top of tf estimators
  ☆51Updated last year
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated last year
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆107Updated last year
• gpuopenanalytics / pynvml
  Provide Python access to the NVML library for GPU diagnostics
  ☆220Updated 3 months ago
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆125Updated 2 weeks ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆146Updated this week
• nv-legate / legate.pandas
  An Aspiring Drop-In Replacement for Pandas at Scale
  ☆74Updated 3 years ago
• NVIDIA-Merlin / gcp-ml-ops
  MLOps pipeline for NVIDIA Merlin on GKE
  ☆41Updated 3 years ago
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated this week
• IntelPython / scikit-learn_bench
  scikit-learn_bench benchmarks various implementations of machine learning algorithms across data analytics frameworks. It currently suppo…
  ☆113Updated last week
• triton-inference-server / core
  The core library and APIs implementing the Triton Inference Server.
  ☆105Updated this week
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆42Updated last year
• NVIDIA / LDDL
  Distributed preprocessing and data loading for language datasets
  ☆39Updated 7 months ago
• rapidsai / docker
  Dockerfile templates for creating RAPIDS Docker Images
  ☆70Updated this week
• SeldonIO / tempo
  MLOps Python Library
  ☆116Updated 2 years ago
• rapidsai / ucx-py
  Python bindings for UCX
  ☆121Updated this week