mask_rcnn_resnet50_atrous_coco#

Use Case and High-Level Description#

Mask R-CNN ResNet50 Atrous trained on Common Objects in Context (COCO) dataset. It is used for object instance segmentation. For details, see the paper.

Specification#

Metric

Value

Type

Instance segmentation

GFlops

294.738

MParams

50.222

Source framework

TensorFlow*

Accuracy#

Metric

Value

coco_orig_precision

29.75%

coco_orig_segm_precision

27.46%

Input#

Original Model#

Image, name: image_tensor, shape: 1, 800, 1365, 3, format: B, H, W, C, where:

  • B - batch size

  • H - image height

  • W - image width

  • C - number of channels

Expected color order: RGB.

Converted Model#

  1. Image, name: image_tensor, shape: 1, 800, 1365, 3, format: B, H, W, C, where:

    • B - batch size

    • H - image height

    • W - image width

    • C - number of channels

    Expected color order: BGR.

  2. Information of input image size, name: image_info, shape: 1, 3, format: B, C, where:

    • B - batch size

    • C - vector of 3 values in format H, W, S, where H is an image height, W is an image width, S is an image scale factor (usually 1)

Output#

Original Model#

  1. Classifier, name: detection_classes. Contains predicted bounding-boxes classes in a range [1, 91]. The model was trained on Common Objects in Context (COCO) dataset version with 90 categories of objects, 0 class is for background.

  2. Probability, name: detection_scores. Contains probability of detected bounding boxes.

  3. Detection box, name: detection_boxes. Contains detection boxes coordinates in a format [y_min, x_min, y_max, x_max], where (x_min, y_min) are coordinates of the top left corner, (x_max, y_max) are coordinates of the right bottom corner. Coordinates are rescaled to input image size.

  4. Detections number, name: num_detections. Contains the number of predicted detection boxes.

  5. Segmentation mask, name: detection_masks. Contains segmentation heatmaps of detected objects for all classes for every output bounding box.

Converted Model#

  1. The array of summary detection information, name: reshape_do_2d, shape: 100, 7 in the format N, 7, where N is the number of detected bounding boxes. For each detection, the description has the format: [image_id, label, conf, x_min, y_min, x_max, y_max], where:

    • image_id - ID of the image in the batch

    • label - predicted class ID

    • conf - confidence for the predicted class

    • (x_min, y_min) - coordinates of the top left bounding box corner (coordinates stored in normalized format, in range [0, 1])

    • (x_max, y_max) - coordinates of the bottom right bounding box corner (coordinates stored in normalized format, in range [0, 1])

  2. Segmentation heatmaps for all classes for every output bounding box, name: masks, shape: 100, 90, 33, 33 in the format N, 90, 33, 33, where N is the number of detected masks, 90 is the number of classes (the background class excluded).

Download a Model and Convert it into OpenVINO™ IR Format#

You can download models and if necessary convert them into OpenVINO™ IR format using the Model Downloader and other automation tools as shown in the examples below.

An example of using the Model Downloader:

omz_downloader --name <model_name>

An example of using the Model Converter:

omz_converter --name <model_name>

Demo usage#

The model can be used in the following demos provided by the Open Model Zoo to show its capabilities: