MLPerf™ Inference is a benchmark suite consisting of carefully selected AI architectures that represent the cutting edge of today’s artificial intelligence. Therefore, it allows for a comprehensive test of how well a given system performs on a variety of machine learning tasks, including natural language processing, computer vision, recommendation engines, and more. It is a consensus on the best benchmarking techniques, forged by experts in architecture, systems and machine learning.

Ampere Altra VMs offer great performance in assortment of AI workloads, including the ones in MLPerf Inference benchmark. ResNet-50 v1.5 is a popular neural network architecture primarily used in the field of computer vision. This model, trained to perform well on ImageNet class prediction task, is part of the MLPerf Inference suite.

Performance data on Azure Public Preview as of 7/1/2022.