In support of IKR 3.3.2 (CoreTrustSeal).
Following on #4502 , we want to increase the efficiency of secondary file validation, so we can increase the number of files we are validating.
- Set up the process on a very small EU-based EC2 server, so we don't need to worry about cross-region download fees
- Allow larger files to be processed (e.g., up to 100GB)
- Validate that the costs are still low, and if so, increase the number of files processed
In support of IKR 3.3.2 (CoreTrustSeal).
Following on #4502 , we want to increase the efficiency of secondary file validation, so we can increase the number of files we are validating.