Precision@k is removed after v0.11.0 #2002
Unanswered
donglihe-hub
asked this question in
Classification
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi TorchMetrics team,
I am thankful for this powerful tool and really appreciate your hard work.
I'm working on evaluating multilabel classification results with precision@k, which is logged by Lightning loggers. I noticed that since v0.11.0, Precison module cannot generalize to Precision@K anymore.
An pseudo example of preds and target in my case is:
To calculate precision@k, I obtain the indices of the top k elements in preds, apply thresholding to them, and calculate precision using the tp and fp obtained from the top_k preds-target pair.
I can achieve my purpose with Precision before 0.11.0. Currently the version of TorchMetrics in my project is stuck to 0.10.3. And I'd like to know if there is an workaround for my problem. Thank you very much.
Beta Was this translation helpful? Give feedback.
All reactions