Releases: Georgetown-University-Libraries/File-Analyzer
Releases · Georgetown-University-Libraries/File-Analyzer
Create One IIIF Range Per Item Level Folder
This release introduces a new IIIF Manifest Project Translation Option based on the directory structure of a set of images.
Refine Command Line Interface for File Analyzer
Run FileTest from the command line
List all file tests
~\Documents\GitHub\File-Analyzer [batch ≡ +6 ~11 -0 !]> java -cp demo\target\DemoFileAnalyzer-2.0.jar edu.georgetown.library.fileAnalyzer.DemoBatchAnalyzer -listparams IIIF -help
Usage:
BatchAnalyzer [-options] [-root rootdir] [-outfile outfile] filetest
to process a single directory, writing results to one file
If absent, rootdir will default to current directory.
If absent, outfile will be generated
or
BatchAnalyer [-options] -batchfile batch filetest
to process a collection of directories
The batch file is a tab separated file containing:
rootdir --> result filenames
where options include
-outdir <dir> Directory to which output files will be written.
Defaults to working directory
-max <num> defaults to 500000
-overwrite defaults to true
-listparams lists the parameters associated with a file test
-listfilters lists the filters associated with a file test
-filter <name> name of the filter to use.
defaults to the first filter
filetest parameters
-param <name> <val> Pass filetest specific parameters
Multiple param vals may be provided
the following options override filter defaults
-prefix <val> Filenames must start with this value
-suffix <val> Filenames must end with this value
-contains <val> Filenames must contain this value
-excludes <val> Filenames may not contain this value
result filtering options
-rf <col> <val> Only output results where column <col> matches <val>
Multiple rf vals may be provided
filetest
ByType Count Files By Type
Files List Files
DIR List Dir
Name Match By Name
BaseName Match By Base Name
Checksum Sort By Checksum
ReadChecksum Read Checksum
Path Match By Path
TypeDir Count By Type and Dir
Random Random Sampling Mil 105E
Lowercase Lowercase Test
LowercaseRename Lowercase Rename
Deriv Digital Derivatives
IngestInventory Ingest Inventory
IngestValidate Ingest Validate
DSpaceDAT DSpaceDAT
ProQuest ProQuest to DSpace Ingest Folder
ProQuestQC ProQuest Metadata QC
Pg Page Count
Image Image Spec
Yearbook Yearbook Test
Bag Create Bag
APTBag Create APTrust Bag
AIPZip->APT Package AIP Zip for APT
AIPDir->APT Package AIP Dir for APT
VerBag Verify Bag - Dir
VerBagZip Verify Bag - Zip
VerBagTar Verify Bag - Tar
VerAPTTAR Verify APTrust Bag - TAR
Counter Counter Compliance
Demo Demo File Test
ItemInventory MARC Item Inventory
IIIF Create IIIF Manifest
List Parameters for a FileTest
~\Documents\GitHub\File-Analyzer [batch ≡ +6 ~11 -0 !]> java -cp demo\target\DemoFileAnalyzer-2.0.jar edu.georgetown.library.fileAnalyzer.DemoBatchAnalyzer -listparams IIIF -listparams
Parameters for File Test: Create IIIF Manifest
manifest-gen-prop manifest-gen-prop Manifest Generation Property Filename
translate translate Project Value Translator: if set to Default, use the value in the property file
List all Importers
~\Documents\GitHub\File-Analyzer [batch ≡ +6 ~11 -0 !]> java -cp demo\target\DemoFileAnalyzer-2.0.jar edu.georgetown.library.fileAnalyzer.DemoBatchImporter -hel
p
Usage:
BatchImporter [-options] -infile inputfile importer
where options include
-outdir Directory to which output files will be written.
Defaults to working directory
-outfile Output file name, defaults to a system generated name
-max defaults to 500000
-overwrite defaults to true
-listparams lists the parameters associated with a file test
importer parameters
-param <name> <val> Pass filetest specific parameters
Multiple param vals may be provided
importer
Delim Import Delimited File
Regex Regular Expression Parser
MultiParse Multi Parser
Key Count Key
IngestFolder Ingest: Create Ingest Folders
ItemUpdateAddBitstreams Ingest: Create Item Update Folders - Add Bitstreams
ItemUpdateDeleteBitstreams Ingest: Create Item Update Folders - Delete Bitstreams
BatchCSV Batch CSV File
Dspace2Marc Convert DSpace Metadata to MARC
MetadataReg Read DSpace Metadata Registry
Counter Counter Compliance
Demo Demo Importer
Marc MARC Rec Validator
Outsourced Outsourced MARC Validation
Encoding MARC Encoding Check
Inventory MARC Inventory
ItemInventory MARC Item Inventory
Serializer MARC Serializer
List all parameters for an importer
~\Documents\GitHub\File-Analyzer [batch ≡ +6 ~11 -0 !]> java -cp demo\target\DemoFileAnalyzer-2.0.jar edu.georgetown.library.fileAnalyzer.DemoBatchImporter ItemUpdateDeleteBitstreams -listparams
Parameters for Importer: Ingest: Create Item Update Folders - Delete Bitstreams
handle-service-baseurl handle-service-baseurl Handle prefix to create match existing item
DSpace Item Update Enhancements
Generate source folders for "dspace itemupdate -A " or "dspace itemupdate -D"
Add support for DSpace REST api for Metadata Retrieval
Merge pull request #73 from Georgetown-University-Libraries/iiif3 Add support for DSpace REST api for Metadata Retrieval
Bug Fix and Enhancement
- Support 2 Page View in Manifest
- Support 3 options for Collection Manifests
- Support path escaping for Cantaloupe server comptibility
Pull IIIF Manifest Data from CSV File
This release includes general refactoring and support for an additional use case in manifest generation.
https://github.com/Georgetown-University-Libraries/File-Analyzer-Test-Data/blob/master/iiif/demo8.md
Pull DAO references from EAD file and integrate into IIIF Manifest
Merge pull request #68 from Georgetown-University-Libraries/iiif3 Code Refactor + Read DAO records defined in the EAD
Generate IIIF Manifests Tutorial
Generate IIIF Manifests
Generate Metadata Rich IIIF Manifest Files
Tutorial will go here: https://github.com/Georgetown-University-Libraries/File-Analyzer-Test-Data/blob/master/iiif/README.md
Allow sub-classing of DelimitedFileReader
v5.1 allow subclass of delimited file reader