Functions | |
void | ie_infer_request_free (ie_infer_request_t **infer_request) |
Releases memory occupied by ie_infer_request_t instance. More... | |
IEStatusCode | ie_infer_request_get_blob (ie_infer_request_t *infer_request, const char *name, ie_blob_t **blob) |
Gets input/output data for inference. More... | |
IEStatusCode | ie_infer_request_set_blob (ie_infer_request_t *infer_request, const char *name, const ie_blob_t *blob) |
Sets input/output data to inference. More... | |
IEStatusCode | ie_infer_request_infer (ie_infer_request_t *infer_request) |
Starts synchronous inference of the infer request and fill outputs. More... | |
IEStatusCode | ie_infer_request_infer_async (ie_infer_request_t *infer_request) |
Starts asynchronous inference of the infer request and fill outputs. More... | |
IEStatusCode | ie_infer_set_completion_callback (ie_infer_request_t *infer_request, ie_complete_call_back_t *callback) |
Sets a callback function that will be called on success or failure of asynchronous request. More... | |
IEStatusCode | ie_infer_request_wait (ie_infer_request_t *infer_request, const int64_t timeout) |
Waits for the result to become available. Blocks until specified timeout elapses or the result becomes available, whichever comes first. More... | |
IEStatusCode | ie_infer_request_set_batch (ie_infer_request_t *infer_request, const size_t size) |
Sets new batch size for certain infer request when dynamic batching is enabled in executable network that created this request. More... | |
Set of functions responsible for dedicated inference for certain ExecutableNetwork.
void ie_infer_request_free | ( | ie_infer_request_t ** | infer_request | ) |
Releases memory occupied by ie_infer_request_t instance.
infer_request | A pointer to the ie_infer_request_t to free memory. |
IEStatusCode ie_infer_request_get_blob | ( | ie_infer_request_t * | infer_request, |
const char * | name, | ||
ie_blob_t ** | blob | ||
) |
Gets input/output data for inference.
infer_request | A pointer to ie_infer_request_t instance. |
name | Name of input or output blob. |
blob | A pointer to input or output blob. The type of Blob must match the network input precision and size. |
IEStatusCode ie_infer_request_infer | ( | ie_infer_request_t * | infer_request | ) |
Starts synchronous inference of the infer request and fill outputs.
infer_request | A pointer to ie_infer_request_t instance. |
IEStatusCode ie_infer_request_infer_async | ( | ie_infer_request_t * | infer_request | ) |
Starts asynchronous inference of the infer request and fill outputs.
infer_request | A pointer to ie_infer_request_t instance. |
IEStatusCode ie_infer_request_set_batch | ( | ie_infer_request_t * | infer_request, |
const size_t | size | ||
) |
Sets new batch size for certain infer request when dynamic batching is enabled in executable network that created this request.
infer_request | A pointer to ie_infer_request_t instance. |
size | New batch size to be used by all the following inference calls for this request. |
IEStatusCode ie_infer_request_set_blob | ( | ie_infer_request_t * | infer_request, |
const char * | name, | ||
const ie_blob_t * | blob | ||
) |
Sets input/output data to inference.
infer_request | A pointer to ie_infer_request_t instance. |
name | Name of input or output blob. |
blob | Reference to input or output blob. The type of a blob must match the network input precision and size. |
IEStatusCode ie_infer_request_wait | ( | ie_infer_request_t * | infer_request, |
const int64_t | timeout | ||
) |
Waits for the result to become available. Blocks until specified timeout elapses or the result becomes available, whichever comes first.
infer_request | A pointer to ie_infer_request_t instance. |
timeout | Maximum duration in milliseconds to block for |
IEStatusCode ie_infer_set_completion_callback | ( | ie_infer_request_t * | infer_request, |
ie_complete_call_back_t * | callback | ||
) |
Sets a callback function that will be called on success or failure of asynchronous request.
infer_request | A pointer to ie_infer_request_t instance. |
callback | A function to be called. |