Deployment

The following tutorials will help you learn how to deploy MXNet on various platforms and in different language environments.

Export

The following tutorials will help you learn export MXNet models.

Export ONNX Models

COMING SOON

Export with GluonCVhttps://gluon-cv.mxnet.io/build/examples_deployment/export_network.html

How to export models trained with MXNet GluonCV.

Inference

The following tutorials will help you learn how to deploy MXNet models for inference applications.

CPP Inferenceinference/cpp.html

How to deploy MXNet C++ Models

Scala Inferenceinference/scala.html

How to run Scala inference

GluonCV Models in a C++ Inference Applicationhttps://gluon-cv.mxnet.io/build/examples_deployment/cpp_inference.html

An example application that works with an exported MXNet GluonCV YOLO model.

Inference with Quantized Modelshttps://gluon-cv.mxnet.io/build/examples_deployment/int8_inference.html

How to use quantized GluonCV models for inference on Intel Xeon Processors to gain higher performance.

Cloud

The following tutorials will show you how to use MXNet on AWS.

MXNet on EC2run-on-aws/use_ec2.html

How to deploy MXNet on an Amazon EC2 instance.

MXNet on SageMakerrun-on-aws/use_sagemaker.html

How to run MXNet using Amazon SageMaker.

MXNet on the cloudrun-on-aws/cloud.html

How to run MXNet on the cloud

Training with Data from S3https://mxnet.apache.org/api/faq/s3_integration

How to train with data from Amazon S3 buckets.

Security

Securing MXNethttps://mxnet.apache.org/api/faq/security

Best practices and deployment considerations.