Skip to content

Conversation

tstadel
Copy link
Member

@tstadel tstadel commented Sep 26, 2025

Related Issues

In the simplest case (file_name_meta_key == s3_key_meta_key):

  • you don't need to configure anything
  • your file is expected to have the same key on your s3 bucket as its file_name (e.g. my_file.txt)
  • you can add prefix and suffixes of course, so if your s3_key would be org/workspace/my_file.txt you can easily configure a prefix org/workspace/

In the platform case (file_name_meta_key != s3_key_meta_key):

  • s3_key_meta_key='file_id'
  • file_name_meta_key='file_name'
  • and we still need to set prefixes and suffixes

Proposed Changes:

How did you test it?

Notes for the reviewer

Checklist

@tstadel tstadel requested a review from a team as a code owner September 26, 2025 12:40
@tstadel tstadel requested review from vblagoje and removed request for a team September 26, 2025 12:40
return None

file_path = self.file_root_path / Path(file_name)
file_path.parent.mkdir(parents=True, exist_ok=True)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just added this in case file_name contains /, such that this does not fail.

@anakin87
Copy link
Member

superseded by #2343

@anakin87 anakin87 closed this Sep 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants