Questions about the version of the lmms-eval

[Wotoosh]

Dear author, the method simple_evaluate in the present https://github.com/EvolvingLMMs-Lab/lmms-eval didn't have the attribute lm. However, the simple_evaluate used in main.py did pass the attribute. If I directly delete the attribute ,the evaluate method would yield AttributeError: 'Namespace' object has no attribute 'process_with_media', I think the problem may cause by the version of the lmm-eval, so I want to ask what version of lmms-eval did you use,many thanks!

[Albert-huyc]

Hi, @Wotoosh , thank you for your interest in our work! The version of lmms-eval we used in this project is v0.2.4. Please let us know if you have any further questions.