common-sign-language-0001#

Use Case and High-Level Description#

A human gesture recognition model for the Jester dataset recognition scenario (gesture-level recognition). The model uses an S3D framework with MobileNet V3 backbone. Please refer to the Jester dataset specification to see the list of gestures that are recognized by this model.

The model accepts a stack of frames (8 frames) sampled with a constant frame rate (15 FPS) and produces a prediction on the input clip.

Specification#

Metric

Value

Top-1 accuracy (continuous Jester)

93.58%

GFlops

4.2269

MParams

4.1128

Source framework

PyTorch*

Input#

Original Model#

Batch of images of the shape 1, 3, 8, 224, 224 in the B, C, T, H, W format, where:

  • B - batch size

  • C - channel

  • T - sequence length

  • H - height

  • W - width

Channel order is RGB.

Converted Model#

Batch of images of the shape 1, 3, 8, 224, 224 in the B, C, T, H, W format, where:

  • B - batch size

  • C - channel

  • T - sequence length

  • H - height

  • W - width

Channel order is RGB.

Output#

The model outputs a tensor with the shape B, 27, each row is a logits vector of performed Jester gestures.

Original Model#

Blob of the shape 1, 27 in the B, C format, where:

  • B - batch size

  • C - predicted logits size

Converted Model#

Blob of the shape 1, 27 in the B, C format, where:

  • B - batch size

  • C - predicted logits size

Download a Model and Convert it into OpenVINO™ IR Format#

You can download models and if necessary convert them into OpenVINO™ IR format using the Model Downloader and other automation tools as shown in the examples below.

An example of using the Model Downloader:

omz_downloader --name <model_name>

An example of using the Model Converter:

omz_converter --name <model_name>

Demo usage#

The model can be used in the following demos provided by the Open Model Zoo to show its capabilities: