The instance segmentation performance rely heavily on keypoints performance

[zdwong]

Pose2Seg model provided by author was used to generate instance segmentation on Crowdhuman dataset with the input of keypoints generated by AlphaPose model. According to the visualization result, the instance segmentation is not so good compared to mask rcnn model because the performance of instance segmentation of Pose2Seg depended heavily on keypoints performance.

The keypoints visualization:

The instance segmentation visualization:

I was amazed when I saw the visualization of instance segmentation in COCO or COHuman dataset. But when using another model to generate keypoints, the result is not good.

[Tetsujinfr]

do you have the Mask RCNN inferred version of this image? just to eyeball both? cause indeed the pixel segmentation you have with pose2seg is not super impressive regarding details, but it does manage occlusion pretty well I would say, no?

[Xuan-YE]

Pose2Seg model provided by author was used to generate instance segmentation on Crowdhuman dataset with the input of keypoints generated by AlphaPose model. According to the visualization result, the instance segmentation is not so good compared to mask rcnn model because the performance of instance segmentation of Pose2Seg depended heavily on keypoints performance.

The keypoints visualization:

The instance segmentation visualization:

I was amazed when I saw the visualization of instance segmentation in COCO or COHuman dataset. But when using another model to generate keypoints, the result is not good.

Hi!
I'm interested in the work you have done.
Could you show me some details about how to run it on my own set of images?
I'm very grateful to you!