Accelerated Backend Tools

The following tutorials will help you learn how to use backend tools to boost performance.

TensorRTtensorrt/index.html

How to use NVIDIA’s TensorRT to boost inference performance.

MKL-DNNmkldnn/index.html

How to get the most from your CPU by using Intel’s MKL-DNN.

TVMtvm.html

How to use TVM to boost performance.

Automatic Mixed Precision (AMP)amp.html

How to use Automatic Mixed Precision to boost performance.

MXNet Operator Profilerprofilder.html

Use the profiler to monitor the performance of individual operators