Ampere AI is a family of software tools that optimizes the processing of AI and ML inference workloads on Ampere processors. With Ampere AI tools, CPU-based inference workloads can take advantage of the cost, performance, scalability and power efficiency of Ampere processors, while enabling users to program with common and standard AI frameworks.

A library that is integrated into many common AI frameworks such as Tensorflow, Pytorch, ONNX Runtime, etc. It accelerates inference without any accuracy loss, conversions, or model retraining. No API changes are required, and it works out-of-the-box for any neural network and workload built for the supported standard frameworks.

AML is a collection of AI models for computer vision, natural language processing and recommendation engine applications. The models have been pretrained on standard datasets and are available for our customers and partners to quickly build into their applications. Ampere provides individual models under a variety of free and open-source licenses. Each individual model package will identify the associated license.

We offer ready-to-use Docker images that can be pulled from Ampere AI solutions website, we include code snippets and documentation along with the link to download after accepting the End user license agreement. Images are also available from our Cloud partners in their marketplaces.

The Docker image includes a standard ML framework (TensorFlow etc.) preinstalled with our optimized SW. It runs on any Ampere processor. You can run your inference scripts without change. Example models like image classification and object detection are provided with the image.

The Ampere Optimized Tensorflow Docker image is installed with Python 3.8.

It is currently based on Ubuntu 20.04. We will continue to expand the support of other Linux distributions.

Our optimized SW components allow an application to control its behavior, like the number of threads and CPU binding, through a set of environment variables. Please refer to the download documentation for details.

No, our optimized frameworks are designed to accelerate inference workloads only. Ampere does support GPU accelerated training on Ampere Altra processors.

Please contact your Ampere sales representative and they can help you find more information. If you are using the software through a 3rd party please contact their customer support team for help. Alternatively, you can also contact the AI team at ai-support@amperecomputing.com