Path prefix from where to load the model artifacts. These include the symbol, parameters, and synset.txt Example: file://model-dir/resnet-152 (containing resnet-152-symbol.json, resnet-152-0000.params, and synset.txt).
Descriptors defining the input node names, shape, layout and type parameters
Note: If the input Descriptors is missing batchSize ('N' in layout), a batchSize of 1 is assumed for the model.
Device contexts on which you want to run inference; defaults to CPU
Model epoch to load; defaults to 0
Device contexts on which you want to run inference; defaults to CPU
Device contexts on which you want to run inference; defaults to CPU
Model epoch to load; defaults to 0
Model epoch to load; defaults to 0
Descriptors defining the input node names, shape, layout and type parameters
Descriptors defining the input node names, shape, layout and type parameters
Note: If the input Descriptors is missing batchSize ('N' in layout), a batchSize of 1 is assumed for the model.
Get model output shapes.
Takes input as IndexedSeq one dimensional arrays and creates the NDArray needed for inference The array will be reshaped based on the input descriptors.
Takes input as IndexedSeq one dimensional arrays and creates the NDArray needed for inference The array will be reshaped based on the input descriptors.
The Scala equivalent of the DType used for the input array and return value
Indexed sequence array of outputs
Predict using NDArray as input This method is useful when the input is a batch of data Note: User is responsible for managing allocation/deallocation of input/output NDArrays.
Predict using NDArray as input This method is useful when the input is a batch of data Note: User is responsible for managing allocation/deallocation of input/output NDArrays.
IndexedSequence NDArrays
Output of predictions as NDArrays
Implementation of prediction routines.