NVIDIA-NeMo / EvaluatorLinks
Open-source library for scalable, reproducible evaluation of AI models and benchmarks.
☆26Updated this week
Alternatives and similar repositories for Evaluator
Users that are interested in Evaluator are comparing it to the libraries listed below
Sorting:
- The WeightWatcher tool for predicting the accuracy of Deep Neural Networks☆1,673Updated 4 months ago
- Pipeline Parallelism for PyTorch☆780Updated last year
- maximal update parametrization (µP)☆1,606Updated last year
- PyTorch extensions for high performance and large scale training.☆3,380Updated 5 months ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,227Updated this week
- Parallelformers: An Efficient Model Parallelization Toolkit for Deployment☆789Updated 2 years ago
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆438Updated last year
- A platform for managing machine learning experiments☆873Updated 2 weeks ago
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,062Updated last year
- Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackab…☆1,582Updated last year
- Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging F…☆574Updated last year
- Library for 8-bit optimizers and quantization routines.☆779Updated 3 years ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆879Updated last week
- Speed up model training by fixing data loading.☆546Updated this week
- Task-based datasets, preprocessing, and evaluation for sequence models.☆586Updated 3 weeks ago
- Accelerate your Neural Architecture Search (NAS) through fast, reproducible and modular research.☆481Updated 11 months ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,436Updated last month
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,449Updated 5 months ago
- TensorDict is a pytorch dedicated tensor container.☆970Updated last week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆394Updated this week
- High performance model preprocessing library on PyTorch☆644Updated last year
- Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀☆1,689Updated 11 months ago
- Robustness Gym is an evaluation toolkit for machine learning.☆442Updated 3 years ago
- Mesh TensorFlow: Model Parallelism Made Easier☆1,616Updated last year
- Long Range Arena for Benchmarking Efficient Transformers☆763Updated last year
- PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri…☆1,413Updated this week
- A library to analyze PyTorch traces.☆416Updated last week
- A library to inspect and extract intermediate layers of PyTorch models.☆473Updated 3 years ago
- Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.☆1,600Updated 3 weeks ago
- The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX☆420Updated last year