Unable to Reproduce Provided stat.pt Mean/Variance

[a-little-hoof]

Hi, thank you for the great work!

I found the models/stats/mae/base_p16/ImageNet1k/stat.pt file in the repo but cannot reproduce the numbers. I compute the mean and variance over my MAE feature tensor with shape (50000, 256, 768) (num_examples × token_length × channel_dim), and I obtain stats with the same shape as yours, but the values do not match.

Could you share more details about how the statistics were generated? I’m not sure what step I might be missing.

Thank you!

[bytetriper]

Hi,

We compute the mean and variance over the full training set, which may help explain the discrepancy. We will release the script used to obtain the mean and variance soon.

[bytetriper]

@a-little-hoof We've just released the script! Feel free to check:)