Conversation
|
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## development #336 +/- ##
==============================================
Coverage ? 82.23%
==============================================
Files ? 65
Lines ? 6795
Branches ? 0
==============================================
Hits ? 5588
Misses ? 1207
Partials ? 0 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
Yes they seem to have made very questionable choices, and I followed them very closely If you don't evaluate properly it is not necessary to have a meaningful model to achieve 'good' results and end up in Nature |
|
Ah, ok, wow!!! Well in that case, I am looking forward to seeing how it performs when properly evaluated :D |
|
I don't get a 'Merge' button, so if someone could please click it for me 😄 |
After you've added it to the docs :D |
JudithBernett
left a comment
There was a problem hiding this comment.
add to docs please :)
A Transformer-based deep learning model designed to predict clinical drug responses
by integrating gene expression profiles and drug molecular structures.
Original authors: Zhou et al. (2025, 10.1038/s41698-025-01082-6)
Code adapted from their Github: https://github.com/zhouyuru1205/PharmaFormer
I investigated their source code thoroughly (as it was one of the most promising models for my internship task) and found the following problems in their evaluation:
Within drevalpy these parts are handled by the library, allowing us to see the actual performance, which is pretty bad.