Skip to content

Add note to use s5cmd for large transfers to LTS #948

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
mdefende wants to merge 1 commit into from
Closed

Add note to use s5cmd for large transfers to LTS #948

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions docs/data_management/lts/interfaces.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,13 @@ LTS is not available as a mounted filesystem on local computers or Cheaha. You m

## Globus

<!-- markdownlint-disable MD046 -->
!!! note

Globus is not recommended for transferring data larger than a few hundred GB between a POSIX filesystem (i.e. Cheaha and all standard desktop OS) and LTS due to issues with transfer rate. Please use [s5cmd](#installation-of-s3cmd-and-s5cmd-on-cheaha) for those cases. Smaller data can be transferred using Globus without issue.

<!-- markdown-lint-enable MD046 -->

[Globus](../transfer/globus.md#long-term-storage-s3-lts-connector) is a general file transfer system that operates through a web browser and is recommended for most file transfer needs. UAB has an S3 connector for Globus that can transfer data to and from LTS as long as the user has access to the desired buckets.

To connect to the LTS endpoint in Globus, search `UAB Research Computing LTS` in the search bar and enter your access and secret keys given to you by Research Computing staff. You will be able to see the buckets owned by the allocation associated with the keys you entered.
Expand Down