Remove test dependency on scikit learn

[larsevj]

Seems overkill just to normalize a matrix.

• PR title captures the intent of the changes, and is fitting for release notes.
• Added appropriate release note label
• Commit history is consistent and clean, in line with the contribution guidelines.
• Make sure unit tests pass locally after every commit (git rebase -i main --exec 'just rapid-tests')

When applicable

• When there are user facing changes: Updated documentation
• New behavior or changes to existing untested code: Ensured that unit tests are added (See Ground Rules).
• Large PR: Prepare changes in small commits for more convenient review
• Bug fix: Add regression test for the bug
• Bug fix: Create Backport PR to latest release

[codspeed-hq]

CodSpeed Performance Report

Merging #9917 will not alter performance

_{Comparing larsevj:remove_scikit_learn_test_dependency (70cc18d) with main (bc9f17b)}

Summary

✅ 25 untouched benchmarks