Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Should we move @with_all_fs test into test_other.py #23424

Closed
sbc100 opened this issue Jan 15, 2025 · 4 comments
Closed

Should we move @with_all_fs test into test_other.py #23424

sbc100 opened this issue Jan 15, 2025 · 4 comments

Comments

@sbc100
Copy link
Collaborator

sbc100 commented Jan 15, 2025

There are bunch of decorators in use now in test_core.py including @with_all_fs test and @also_with_nodefs_both.

Having these in test_core.py mean that we have a combinatorial explosion of tests here. Should we move these tests into test_other.py? @kripken is there any reason to keep these FS tests in test_core.py?

@sbc100
Copy link
Collaborator Author

sbc100 commented Jan 15, 2025

@kripken

@kripken
Copy link
Member

kripken commented Jan 16, 2025

Some FS tests benefit from coverage of optimizations, our JS optimizer and also closure. Another factor is that by being in core we get coverage of wasm64 and sanitizers.

But probably a lot of them can be moved to other. Deciding which is hard to automate, though, I worry.

@sbc100
Copy link
Collaborator Author

sbc100 commented Jan 16, 2025

OK, closing this for.

Interestingly enough the other suite take a lot longer to run than the core suite on my machine.. so maybe moving stuff isn't the best idea anyway.

other --skip-slow: 358.455s
core0 --skip-slow: 168.206s
core2 --skip-slow: 210.055s

@sbc100 sbc100 closed this as completed Jan 16, 2025
@kripken
Copy link
Member

kripken commented Jan 16, 2025

Yeah, if we wanted to reduce wall time we'd want to split up other first, I guess. But the total work of all the core* modes is pretty high, and for FS I do agree it is mostly wasteful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants