Skip to main content

004506: Error: <value>. Estimate Batch Size function does not support this model type. Inferencing was not successful. Please manually specify a smaller batch size and run again.

Description

The GPU ran out of memory during inferencing. This model does not supported an estimated batch size.

Solution

Specify a smaller batch size when inferencing, and run the tool again.