[FLAVA]Move itm head to flava model for pretraining

[ankitade]

Stack from ghstack (oldest at bottom):

• [FLAVA]Separate the pretraining loss from the pretraininig model #278
• [FLAVA] Move masked prediction head to flava_for_pretraining #195
• -> [FLAVA]Move itm head to flava model for pretraining #132
• change order of itm loss init #131

Differential Revision: D38101609

[codecov-commenter]

Codecov Report

❗ No coverage uploaded for pull request base (gh/ankitade/9/base@fb5a3ed). Click here to learn what that means.
The diff coverage is n/a.

@@                  Coverage Diff                  @@
##             gh/ankitade/9/base     #132   +/-   ##
=====================================================
  Coverage                      ?   92.09%           
=====================================================
  Files                         ?       53           
  Lines                         ?     3161           
  Branches                      ?        0           
=====================================================
  Hits                          ?     2911           
  Misses                        ?      250           
  Partials                      ?        0           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

[ankitade]

@ankitade has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

[ankitade]

@ankitade has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

[ankitade]

@ankitade has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.