Motivation

The methodpredict inmmseg/models/decode_heads/mask2former_head.py is incompatible with the'slide' inference mode.

To elaborate, on line 280 ofslide_inference inmmseg/models/segmentors/encoder_decoder.py, the key'img_shape' ofbatch_img_metas[0] is overwritten by the shape of the cropped image / sliding window.

In line 353 ofmmseg/models/decode_heads/decode_head.py, this is the first key that is used to get the target size for upsampling. As such,crop_seg_logits will have the same shape ascrop_img.

Inmmseg/models/decode_heads/mask2former_head.py, the first shape that is referenced as a target for upsampling is'pad_shape' instead. Sinceslide_inference does not overwrite this key, each cropped image is upsampled to the size of the full image, and then further padded with zeros byslide_inference, leading to a dimension mismatch when trying to add up the paddedcrop_seg_logits. This leads to the issue described in#3666.

Modification

I have simply adjusted the size selection inmmseg/models/decode_heads/mask2former_head.py to match that ofmmseg/models/decode_heads/decode_head.py. As a result, a dimension mismatch no longer occurs when using slide inference with a Mask2Former head.

Checklist

1. Pre-commit or other linting tools are used to fix the potential lint issues.
2. The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
3. If the modification has potential influence on downstream projects, this PR should be tested with downstream projects, like MMDet or MMDet3D.
4. The documentation has been modified accordingly, like docstring or example tutorials.