clmm validation tests #8
Description
This thread is for people to brainstorm validation tests for the code as the refactor progresses.
A first basic test would be to produce some ideal NFW, Einasto, DK (and whatever other profiles y'all want implemented) clusters with some added noise and see if CLMM can recover the correct cluster parameters. We should do this for a variety of SNR and masses (maybe around 10^13.8 or so to 10^15 solar masses/h).
I think another important test would be trying to use CLMM to investigate mass bias for simulated hydro clusters that don't come from cosmo-OWLS or BAHAMAS. Both of these implement AGN feedback from Booth and Schaye 2009, and since AGN feedback seems to be one of the most important non-gravity processes, it'd be nice to test on clusters produced with a different AGN prescription. In my project I found that, when concentration is left free, NFW mass bias does not significantly change when baryons are present in cosmo-OWLS clusters. However, clusters at low SNR tend to have very poorly constrained concentration which tends to drive the estimated mass down depending on your upper limit on c. Mummery et al 2017 found that M-c relations can depend on baryon implementation, so we should be careful if we want to use one of those. Anja mentioned it may be possible to use an M-c relation as a prior that's sufficiently wide enough to capture variations in baryonic physics, though I didn't explore that.
I'll probably keep adding to this as I think of stuff.
-Brandyn