Run MXNet Scala Examples Using the IntelliJ IDE (macOS)¶

This tutorial guides you through setting up a Scala project in the IntelliJ IDE on macOS, and shows how to use the MXNet package from your application.

Prerequisites:¶

To use this tutorial you need the following software:

Java 8 JDK
Maven
Scala - comes with IntelliJ, so you don’t need to install it separately
OpenCV
IntelliJ IDE

The following instructions are provided for macOS and Ubuntu 16.04. Windows support is not yet available.

Mac Prerequisites Setup¶

Step 1. Install brew:

/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

Or, if you already have brew, update it:

brew update

Step 2. Install Java 8 JDK:

brew tap caskroom/versions
brew cask install java8

Step 3. Install maven:

brew install maven

Step 4. Install OpenCV:

brew install opencv@2

Ubuntu Prerequisites Setup¶

Step 1.: Download the MXNet source.

git clone --recursive https://github.com/apache/incubator-mxnet.git mxnet
cd mxnet

Step 2.: Run the dependency installation scripts.

sudo ./ci/docker/install/ubuntu_core.sh
sudo ./ci/docker/install/ubuntu_scala.sh

Access the Maven Package for MXNet¶

To view the latest Maven packages, you can check the Maven repository for the org.apache.mxnet packages.

MXNet Maven Packages

In the tutorial below, you will install the latest package at the time of this writing. You may find a different artifact for your specific operating system, or a newer one by reviewing what is currently available in the Maven repo.

The configuration you should update is in the pom file’s dependency for MXNet:

<dependency>
  <groupId>org.apache.mxnetgroupId>
  <artifactId>mxnet-full_2.11-osx-x86_64-cpuartifactId>
  <version>1.2.0version>
dependency>

Set Up Your Project¶

Now that you’ve installed your prerequisites, you are ready to setup IntelliJ and your first MXNet-Scala project!

Step 1. Install and setup IntelliJ: - When prompted for what to features to enable during IntelliJ’s first startup, make sure you select Scala.

- Install the plugin for IntelliJ IDE by following these steps:

On Menu, choose Preferences, choose Plugins, type Scala, and then choose Install. For further plugin help and instructions, refer to Scala plugin setup for IDE.

Step 2. Create a new project:

intellij welcome

From the IntelliJ welcome screen, select “Create New Project”.

maven project type

Choose the Maven project type.

maven project type - archetype

Select the checkbox for Create from archetype.

maven project type - archetype

Click the Add Archetype button, and add the following information to each field.

GroupId

net.alchim31.maven

ArtifactId

scala-archetype-simple

Version

1.6.0

Repository

https://mvnrepository.com/artifact/net.alchim31.maven/scala-archetype-simple

maven project type - archetype

Click Ok to add the archetype, make sure it is selected from the list, and then click Next.

project metadata

Set the project’s metadata. For this tutorial, use the following:

GroupId

mxnet

ArtifactId

ArtifactId: scalaMXNet

Version

1.0-SNAPSHOT

project properties

Review the project’s properties. The settings can be left as their default.

project location

Set the project’s location. The rest of the settings can be left as their default.

project 1

After clicking Finish, you will be presented with the project’s first view. The project’s pom.xml will be open for editing.

Step 3. Replace the pom file’s content with the following code. Changes include:

Project properties: scala.version, upgrading from 2.11.5 to 2.11.8
Project dependencies: adding the MXNet package from Maven and updating the dependency for JUnitRunner (specs2-junit_)
Build options: removing ‘-make:transitive’

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
  <modelVersion>4.0.0modelVersion>
  <groupId>mxnetgroupId>
  <artifactId>scalaMXNetartifactId>
  <version>1.0-SNAPSHOTversion>
  <name>${project.artifactId}name>
  <description>My wonderful scala appdescription>
  <inceptionYear>2018inceptionYear>
  <licenses>
    <license>
      <name>Apache2name>
      <url>http://mxnet.apache.orgurl>
      <distribution>repodistribution>
    license>
  licenses>
  <profiles>
    <profile>
      <id>osx-x86_64-cpuid>
      <properties>
        <platform>osx-x86_64-cpuplatform>
      properties>
    profile>
    <profile>
      <id>linux-x86_64-cpuid>
      <properties>
        <platform>linux-x86_64-cpuplatform>
      properties>
    profile>
    <profile>
      <id>linux-x86_64-gpuid>
      <properties>
        <platform>linux-x86_64-gpuplatform>
      properties>
    profile>
  profiles>
  <properties>
    <maven.compiler.source>1.6.0maven.compiler.source>
    <maven.compiler.target>1.6.0maven.compiler.target>
    <encoding>UTF-8encoding>
    <scala.version>2.11.8scala.version>
    <scala.compat.version>2.11scala.compat.version>
  properties>

  <dependencies>
    <dependency>
      <groupId>org.apache.mxnetgroupId>
      <artifactId>mxnet-full_2.11-osx-x86_64-cpuartifactId>
      <version>1.2.0version>
    dependency>
    <dependency>
      <groupId>org.scala-langgroupId>
      <artifactId>scala-libraryartifactId>
      <version>${scala.version}version>
    dependency>

    
    <dependency>
      <groupId>junitgroupId>
      <artifactId>junitartifactId>
      <version>4.11version>
      <scope>testscope>
    dependency>
    <dependency>
      <groupId>org.specs2groupId>
      <artifactId>specs2-junit_${scala.compat.version}artifactId>
      <version>2.4.16version>
      <scope>testscope>
    dependency>
    <dependency>
      <groupId>org.scalatestgroupId>
      <artifactId>scalatest_${scala.compat.version}artifactId>
      <version>2.2.4version>
      <scope>testscope>
    dependency>
  dependencies>

  <build>
    <sourceDirectory>src/main/scalasourceDirectory>
    <testSourceDirectory>src/test/scalatestSourceDirectory>
    <plugins>
      <plugin>
        
        <groupId>net.alchim31.mavengroupId>
        <artifactId>scala-maven-pluginartifactId>
        <version>3.2.0version>
        <executions>
          <execution>
            <goals>
              <goal>compilegoal>
              <goal>testCompilegoal>
            goals>
            <configuration>
              <args>
                
                <arg>-dependencyfilearg>
                <arg>${project.build.directory}/.scala_dependenciesarg>
              args>
            configuration>
          execution>
        executions>
      plugin>
      <plugin>
        <groupId>org.apache.maven.pluginsgroupId>
        <artifactId>maven-surefire-pluginartifactId>
        <version>2.18.1version>
        <configuration>
          <useFile>falseuseFile>
          <disableXmlReport>truedisableXmlReport>
          
          
          <includes>
            <include>**/*Test.*include>
            <include>**/*Suite.*include>
          includes>
        configuration>
      plugin>
    plugins>
  build>
project>

Step 4. Import dependencies with Maven:

Note the prompt in the lower right corner that states “Maven projects need to be imported”. If this is not visible, click on the little greed balloon that appears in the lower right corner.

import dependencies

Click “Import Changes” in this prompt.

Step 5. Build the project:

To build the project, from the menu choose Build, and then choose Build Project.

Step 6. Run the Hello World App:

hello world app

Navigate to the App included with the project.

run hello world

Run the App by clicking the green arrow, and verify the Hello World output

Step 7. Run Sample MXNet Code in the App:

run hello mxnet

Paste the following code in the App, overwriting the original hello world code. Then click the green arrow to run it.

object App extends App {
  import org.apache.mxnet._

  private val a = NDArray.ones(2, 3)
  println("Testing MXNet by generating an 2x3 NDArray...")
  println("Shape is: ")
  println(a.shape)
}

The result should be this output:

Testing MXNet by generating an 2x3 NDArray...
Shape is:
(2,3)

Process finished with exit code 0

Troubleshooting¶

If you get an error, check the dependencies at the beginning of this tutorial. For example, you might see the following in the middle of the error messages.

...
Library not loaded: /usr/local/opt/opencv@2/lib/libopencv_calib3d.2.4.dylib
...

This can be resolved be installing OpenCV2.

Troubleshooting¶

If you get an error, check if it is like this one regarding OpenCV. For example, you might see the following in the middle of the error messages.

...
Library not loaded: /usr/local/opt/opencv@2/lib/libopencv_calib3d.2.4.dylib
...

This can be resolved be installing OpenCV2.

Command Line Build Option¶

You can also compile the project by using the following command at the command line. Change directories to this project’s folder then run the following:

mvn clean package -e -P osx-x86_64-cpu

The -P parameter tells the build which platform to target. The -e will give you more details if the build fails. If it succeeds, you should see a lot of info and some warning messages, followed by:

[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1.186 s
[INFO] Finished at: 2018-03-06T15:17:36-08:00
[INFO] Final Memory: 11M/155M
[INFO] ------------------------------------------------------------------------

The build generates a new jar file in the target folder called scalaInference-1.0-SNAPSHOT.jar.

Next Steps¶

For more information about MXNet Scala resources, see the following: