Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A question about soft-mask calculation #1

Open
peter943 opened this issue Jun 17, 2020 · 2 comments
Open

A question about soft-mask calculation #1

peter943 opened this issue Jun 17, 2020 · 2 comments

Comments

@peter943
Copy link

Wonderful job!I studied your paper and code these days, which is very enlightening to me.

I have a question about the code to calculate the soft-mask by soft = self.maskconv(x). I'm not quite sure what the reason for choosing this (conv+fc) network to calculate the soft-mask. Thank you for your kind help.

@thomasverelst
Copy link
Owner

thomasverelst commented Jun 17, 2020

Hi, thanks for your interest in our work! I suppose you are referring to the classification code.
In classification, we use the same mask unit as the work we compare with (SACT). The mask unit is shown in Figure 6 of their paper ( https://arxiv.org/abs/1612.02297 ). It uses a convolution combined with a global average pooling to capture image context. We refer to this as "squeeze unit" as it resembles a squeeze operation of Squeezenet.

However, on pose estimation we noticed the squeeze unit had a significant performance hit (even though the amount of FLOPS is negligible). Table 2 in our paper ( https://arxiv.org/pdf/1912.03203.pdf ) compares the accuracy and inference speed of a simple 1x1 convolution and the squeeze unit. The 1x1 convolution results in slightly lower accuracy but faster inference.

Therefore:
Classification experiments -> Squeeze unit for accuracy reasons
Pose estimation -> 1x1 convolution for inference speed reasons

@peter943
Copy link
Author

peter943 commented Jun 18, 2020

@thomasverelst
Thank you for your patient reply. It helps me a lot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants