Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for mono 3D random resize augmentation #72

Open
ZCMax opened this issue Oct 24, 2022 · 4 comments
Open

Support for mono 3D random resize augmentation #72

ZCMax opened this issue Oct 24, 2022 · 4 comments

Comments

@ZCMax
Copy link

ZCMax commented Oct 24, 2022

Have you ever tried 3D random resize augmentation in monocular 3d object detection?

@Owen-Liuyuxuan
Copy link
Owner

Did you mean "RandomWarpAffine" which resizes and crops the image into a random size and then pads it to the target shape?

class RandomWarpAffine(object):

This augmentation requires the method to be robust to varying camera intrinsic, and is very important for centernet-based methods.

@ZCMax
Copy link
Author

ZCMax commented Oct 24, 2022

Yes, I'm confused that when resizing images, not only the 2d bboxes should be resized, the 3d labels like depth seems also need to be adjusted, but I have tried multi-scale training on several mono3d model, which results in the performance drop.

@Owen-Liuyuxuan
Copy link
Owner

Yes, you could read the code and know that depth images will resize following the main images.

However, the main problem is that many mono3d models directly predict depth, or like GAC we use a fixed prior for anchors. The depth prediction will failed for these methods.

@ZCMax
Copy link
Author

ZCMax commented Nov 1, 2022

Yes, you could read the code and know that depth images will resize following the main images.

However, the main problem is that many mono3d models directly predict depth, or like GAC we use a fixed prior for anchors. The depth prediction will failed for these methods.

Yes, that's the trouble which we need to consider

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants