Skip to main content

004505: Error: <value>. Estimate Batch Size function still can not estimate a suitable batch size. Inferencing was not successful. Please manually specify a smaller batch size and run again.

Description

The GPU ran out of memory during inferencing. The batch size cannot be automatically estimated.

Solution

Specify a smaller batch size when inferencing, and run the tool again.