Skip to main content

004507: The GPU ran out of memory during inferencing. The batch size cannot be automatically estimated. Manually specify a smaller batch size and run the tool again.

Description

The GPU ran out of memory during inferencing. The batch size cannot be automatically estimated.

Solution

Specify a smaller batch size when inferencing this model, and run the tool again.