Accelerated Backend Tools

The following tutorials will help you learn how to use backend tools to boost performance.

TensorRT

How to use NVIDIA’s TensorRT to boost inference performance.

MKL-DNN

How to get the most from your CPU by using Intel’s MKL-DNN.

TVM

How to use TVM to boost performance.

Automatic Mixed Precision (AMP)

How to use Automatic Mixed Precision to boost performance.

MXNet Operator Profiler

Use the profiler to monitor the performance of individual operators