Skip to content

Commit d04e106

Browse files
dustymcdustymc
committed
.
Signed-off-by: dustymc <[email protected]>
1 parent 5bebe14 commit d04e106

File tree

2 files changed

+100
-47
lines changed

2 files changed

+100
-47
lines changed

‎.project

+11
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
<?xml version="1.0" encoding="UTF-8"?>
2+
<projectDescription>
3+
<name>documentation-wiki</name>
4+
<comment></comment>
5+
<projects>
6+
</projects>
7+
<buildSpec>
8+
</buildSpec>
9+
<natures>
10+
</natures>
11+
</projectDescription>

‎_how_to/How-to-Upload-Media-to-TACC.markdown

+89-47
Original file line numberDiff line numberDiff line change
@@ -1,47 +1,89 @@
1-
---
2-
title: How To Upload Media to TACC
3-
layout: default_toc
4-
date: 2018-05-04
5-
---
6-
7-
The Texas Advanced Computing Center (TACC) offers media hosting for Arctos users through an Arctos Project allocation. If you are using TACC to store media, the files must be uploaded to TACC and accessible on the web server before creating media in Arctos
8-
* See [How to Create Media in Arctos](/how_to/How-to-Create-Media-Images.html)
9-
10-
If you want to upload a lot of large media files (e.g., 100s or 1000s of images, audio, video), and/or if you have specific processing needs, you should first contact [Chris Jordan](https://www.tacc.utexas.edu/about/directory/chris-jordan) and an Arctos administrator to discuss space allocations. However, most users can follow these instructions:
11-
12-
* Create a TACC User account through the [TACC User Portal](http://portal.tacc.utexas.edu)
13-
* Direct link: [https://portal.tacc.utexas.edu/account-request](https://portal.tacc.utexas.edu/account-request)
14-
15-
* Once you have created a new account, it may take 24 hours or so for the account to become active
16-
* You should receive an email when your account is approved and ready
17-
18-
* Email your account username to Carla Cicero ([[email protected]](mailto:[email protected])) (TACC Project Manager for Arctos) so that she can add your user account to the Arctos Project allocation
19-
* NOTE: MVZ Users are added to the MVZ Media & Archives Project
20-
21-
* You will need an SFTP (Secure File Transfer Protocol) program in order to access the Corral system on TACC where Arctos media are stored - see the [TACC Corral User Guide](https://portal.tacc.utexas.edu/user-guides/corral)
22-
* On the left you’ll see [Transferring Files Using Cyberduck](https://portal.tacc.utexas.edu/user-guides/corral#cyberduck) - download Cyberduck or use another SFTP program
23-
24-
* Set up a transfer protocol:
25-
* Open Connection
26-
* Select “SFTP” from dropdown
27-
* Server Host Name: data.tacc.utexas.edu
28-
* Username: enter your TACC portal username
29-
* Password: enter your TACC portal account password
30-
* Port number is 22
31-
32-
![TACC Corral Login Screen](https://raw.githubusercontent.com/ArctosDB/documentation-wiki/master/tutorial_images/TACC_corral_login_screenshot.jpg)
33-
34-
35-
* Once you are connected, go up to the root directory and then select corral-tacc ---> tacc ---> arctos
36-
37-
* Each institution should have a directory for their media, e.g, /corral-tacc/tacc/arctos/mvz
38-
* Within that directory, you can organize your media files however you want
39-
40-
* TACC must ingest those files in order for them to appear on the web server: [http://web.corral.tacc.utexas.edu](http://web.corral.tacc.utexas.edu) - files are also processed during this stage (e.g., from dng or tiff to jpeg, wav to mp3, etc.)
41-
* Contact [Chris Jordan](https://www.tacc.utexas.edu/about/directory/chris-jordan) when your file are ready for processing and ingestion
42-
43-
If you have uploaded images, a directory of thumbnail images will also be created. You need to use those thumbnail URIs in your bulkload media template (in the PREVIEW_URI column, http://arctos.database.museum/tools/BulkloadMedia.cfm) when you bulkload the image URIs.
44-
45-
## Tools
46-
47-
* [namechanger](https://mrrsoftware.com/namechanger/) is useful for renaming files on Mac.
1+
---
2+
title: How To Upload Media to TACC
3+
layout: default_toc
4+
date: 2018-05-04
5+
---
6+
7+
The Texas Advanced Computing Center (TACC) offers media hosting for Arctos users through an Arctos Project allocation. If you are using TACC to store media, the files must be uploaded to TACC and accessible on the web server before creating media in Arctos
8+
* See [How to Create Media in Arctos](/how_to/How-to-Create-Media-Images.html)
9+
10+
If you want to upload a lot of large media files (e.g., 100s or 1000s of images, audio, video), and/or if you have specific processing needs, you should first contact [Chris Jordan](https://www.tacc.utexas.edu/about/directory/chris-jordan) and an Arctos administrator to discuss space allocations. However, most users can follow these instructions:
11+
12+
* Create a TACC User account through the [TACC User Portal](http://portal.tacc.utexas.edu)
13+
* Direct link: [https://portal.tacc.utexas.edu/account-request](https://portal.tacc.utexas.edu/account-request)
14+
15+
* Once you have created a new account, it may take 24 hours or so for the account to become active
16+
* You should receive an email when your account is approved and ready
17+
18+
* Email your account username to Carla Cicero ([[email protected]](mailto:[email protected])) (TACC Project Manager for Arctos) so that she can add your user account to the Arctos Project allocation
19+
* NOTE: MVZ Users are added to the MVZ Media & Archives Project
20+
21+
* You will need an SFTP (Secure File Transfer Protocol) program in order to access the Corral system on TACC where Arctos media are stored - see the [TACC Corral User Guide](https://portal.tacc.utexas.edu/user-guides/corral)
22+
* On the left you’ll see [Transferring Files Using Cyberduck](https://portal.tacc.utexas.edu/user-guides/corral#cyberduck) - download Cyberduck or use another SFTP program
23+
24+
* Set up a transfer protocol:
25+
* Open Connection
26+
* Select “SFTP” from dropdown
27+
* Server Host Name: data.tacc.utexas.edu
28+
* Username: enter your TACC portal username
29+
* Password: enter your TACC portal account password
30+
* Port number is 22
31+
32+
![TACC Corral Login Screen](https://raw.githubusercontent.com/ArctosDB/documentation-wiki/master/tutorial_images/TACC_corral_login_screenshot.jpg)
33+
34+
35+
* Once you are connected, go up to the root directory and then select corral-tacc ---> tacc ---> arctos
36+
37+
* Each institution should have a directory for their media, e.g, /corral-tacc/tacc/arctos/mvz
38+
* Within that directory, you can organize your media files however you want
39+
40+
* TACC must ingest those files in order for them to appear on the web server: [http://web.corral.tacc.utexas.edu](http://web.corral.tacc.utexas.edu) - files are also processed during this stage (e.g., from dng or tiff to jpeg, wav to mp3, etc.)
41+
* Contact [Chris Jordan](https://www.tacc.utexas.edu/about/directory/chris-jordan) when your file are ready for processing and ingestion
42+
43+
If you have uploaded images, a directory of thumbnail images will also be created. You need to use those thumbnail URIs in your bulkload media template (in the PREVIEW_URI column, http://arctos.database.museum/tools/BulkloadMedia.cfm) when you bulkload the image URIs.
44+
45+
## Tools
46+
47+
* [namechanger](https://mrrsoftware.com/namechanger/) is useful for renaming files on Mac.
48+
49+
## Media Bulkloader
50+
51+
After uploading, the directory can be used to build a media bulkloader file which creates media objects using the uploaded files in Arctos.
52+
53+
54+
We'll use this directory to demonstrate.
55+
56+
https://web.corral.tacc.utexas.edu/UAF/uam_ento/2018_05_22/
57+
58+
Thumbnails are:
59+
60+
https://web.corral.tacc.utexas.edu/UAF/uam_ento/2018_05_22/tb/
61+
62+
and are prefixed with "tn_"
63+
64+
Open the bulkloader
65+
66+
<img width="363" alt="screen shot 2018-05-23 at 1 06 39 pm" src="https://user-images.githubusercontent.com/5720791/40448362-2ae1fc92-5e8a-11e8-83d2-b6bdd84acfef.png">
67+
68+
and paste the directory URL in to the "Directory URL" box and click the accompanying button.
69+
70+
The pattern of these filenames is {barcode}{sometimes underbar}{dot}{jpg}
71+
72+
ignore folders with "Filter for extension (eg, ".jpg")"
73+
74+
regexfind=_.*$ captures the information before the first underbar for variable "[filename]." (This common situation is documented in the inline documentation at the top of the page.)
75+
76+
Preview Directory URL is the folder containing the thumbnails
77+
78+
Preview prefix (eg, "tn_") - enter "tn_" to prepend to the image filenames
79+
80+
Preview extension (eg, ".jpg") - enter ".jpg" for jpg previews
81+
82+
Select a license, media type, and mime type.
83+
84+
The bulkloader will accept a part's barcode as a proxy to cataloged items. We've extracted that from the filename with the regex above, so all that's necessary is to include the variable in relationship term.
85+
86+
<img width="759" alt="screen shot 2018-05-23 at 1 12 21 pm" src="https://user-images.githubusercontent.com/5720791/40448644-fc399ca0-5e8a-11e8-9cda-a32bda279b55.png">
87+
88+
Scroll down, click "build/rebuild," confirm that everything worked as expected, download CSV, fill in any remaining blanks (or use the tool to do so before downloading), load to the media bulkloader, wait for email.
89+

0 commit comments

Comments
 (0)