TensorFlow* Object Detection Mask R-CNNs Segmentation C++ Demo¶
This topic demonstrates how to run the Segmentation demo application, which does inference using image segmentation networks created with Object Detection API.
The demo has a post-processing part that gathers mask arrays corresponding to bounding boxes with high probability taken from the Detection Output layer. Then the demo produces pictures with identified masks.
How It Works¶
On startup, the demo application reads command line parameters and loads a model and an image to OpenVINO™ Runtime plugin. When inference is done, the application creates an output image.
By default, Open Model Zoo demos expect input with BGR channels order. If you trained your model to work with RGB order, you need to manually rearrange the default channels order in the demo application or reconvert your model using the Model Optimizer tool with the
--reverse_input_channels argument specified. For more information about the argument, refer to When to Reverse Input Channels section of Embedding Preprocessing Computation.
Preparing to Run¶
For demo input image or video files, refer to the section Media Files Available for Demos in the Open Model Zoo Demos Overview. The list of models supported by the demo is in
<omz_dir>/demos/mask_rcnn_demo/cpp/models.lst file. This file can be used as a parameter for Model Downloader and Converter to download and, if necessary, convert models to OpenVINO IR format (*.xml + *.bin).
An example of using the Model Downloader:
omz_downloader --list models.lst
An example of using the Model Converter:
omz_converter --list models.lst
Refer to the tables Intel’s Pre-Trained Models Device Support and Public Pre-Trained Models Device Support for the details on models inference support at different devices.
Running the application with the
-h option yields the following usage message:
mask_rcnn_demo [OPTION] Options: -h Print a usage message. -i "<path>" Required. Path to a .bmp image. -m "<path>" Required. Path to an .xml file with a trained model. -d "<device>" Optional. Specify the target device to infer on (the list of available devices is shown below). Use "-d HETERO:<comma-separated_devices_list>" format to specify HETERO plugin. The demo will look for a suitable plugin for a specified device (CPU by default) -detection_output_name "<string>" Optional. The name of detection output layer. Default value is "reshape_do_2d" -masks_name "<string>" Optional. The name of masks layer. Default value is "masks"
Running the application with the empty list of options yields the usage message given above and an error message.
You can use the following command to do inference on CPU on an image using a trained network:
./mask_rcnn_demo -i <path_to_image>/inputImage.bmp -m <path_to_model>/mask_rcnn_inception_resnet_v2_atrous_coco.xml
For each input image the application outputs a segmented image. For example,
out1.png are created for the network with batch size equal to 2. The demo reports:
Latency : average time required to process one frame (from reading the frame to displaying the results).
You can use this metric to measure application-level performance.