Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TIFFStackReader speed #2000

Open
adamdoc opened this issue Nov 29, 2024 · 2 comments
Open

TIFFStackReader speed #2000

adamdoc opened this issue Nov 29, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@adamdoc
Copy link

adamdoc commented Nov 29, 2024

Description

TIFFStackReader is a lot slower than the max read speed of my given hardware

For a 17.6GB dataset:
TIFFStackReader takes roughly 100sec (180MB/s)
ImageJ takes 30sec (600MB/s)
PIL in python takes 61sec (300MB/s)

The data is on a SSD on a PCIe slot on the motherboard, so the 180MB/s speed is very slow. I've recently started using 100GB datasets, so this equates to near 10mins of data loading time which can be quite tedious for testing different configurations

Environment

cil 24.2.0 np126py312_0 ccpi

@adamdoc adamdoc added the enhancement New feature or request label Nov 29, 2024
@gfardell
Copy link
Member

Thanks @adamdoc is this on windows or Linux?

It's certainly something we can look in to!

@adamdoc
Copy link
Author

adamdoc commented Dec 2, 2024

Thanks, I'm on Windows 11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants