How to visualize the attention map for Scene-Inst. Cross-Attention like Figure 5 in the paper?

[ge95net]

Hi, I am really appreciate the brilliant work!

I just wonder how to visualize the attention map for Scene-Inst. Cross-Attention like Figure 5 in the paper?

thank you very much !

[npurson]

To visualize the activation map for cross attention, you can compute the affinity matrix, which is the N × N matrix obtained by calculating the dot product Q • K in the attention mechanism, where N represents the number of voxels. Then you can visualize the activation of shape N by traversing the matrix.