human-pose-estimation-0001

Use Case and High-Level Description

This is a multi-person 2D pose estimation network (based on the OpenPose approach) with tuned MobileNet v1 as a feature extractor. For every person in an image, the network detects a human pose: a body skeleton consisting of keypoints and connections between them. The pose may contain up to 18 keypoints: ears, eyes, nose, neck, shoulders, elbows, wrists, hips, knees, and ankles.

Example

_images/human-pose-estimation-0001.png

Specification

Metric

Value

Average Precision (AP)

42.8%

GFlops

15.435

MParams

4.099

Source framework

Caffe*

Average Precision metric described in COCO Keypoint Evaluation site.

Tested on a COCO validation subset from the original paper Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields.

Inputs

Image, name: data, shape: 1, 3, 256, 456 in the B, C, H, W format, where:

  • B - batch size

  • C - number of channels

  • H - image height

  • W - image width

Expected color order is BGR.

Outputs

The net outputs are two blobs:

  1. Name: Mconv7_stage2_L1, shape: 1, 38, 32, 57 contains keypoint pairwise relations (part affinity fields).

  2. Name: Mconv7_stage2_L2, shape: 1, 19, 32, 57 contains keypoint heatmaps.

Use Case and High-Level Description

This is a multi-person 2D pose estimation network (based on the OpenPose approach) with tuned MobileNet v1 as a feature extractor. For every person in an image, the network detects a human pose: a body skeleton consisting of keypoints and connections between them. The pose may contain up to 18 keypoints: ears, eyes, nose, neck, shoulders, elbows, wrists, hips, knees, and ankles.

Example

_images/human-pose-estimation-0001.png

Specification

Metric

Value

Average Precision (AP)

42.8%

GFlops

15.435

MParams

4.099

Source framework

Caffe*

Average Precision metric described in COCO Keypoint Evaluation site.

Tested on a COCO validation subset from the original paper Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields.

Inputs

Image, name: data, shape: 1, 3, 256, 456 in the B, C, H, W format, where:

  • B - batch size

  • C - number of channels

  • H - image height

  • W - image width

Expected color order is BGR.

Outputs

The net outputs are two blobs:

  1. Name: Mconv7_stage2_L1, shape: 1, 38, 32, 57 contains keypoint pairwise relations (part affinity fields).

  2. Name: Mconv7_stage2_L2, shape: 1, 19, 32, 57 contains keypoint heatmaps.

Legal Information

[*] Other names and brands may be claimed as the property of others.