Skip to content

Final feature validation #16

@codaich

Description

@codaich
  • Test on SLAC, Bodhidharma MIDI, MIDI_Malcolm and MEI test sets.
    • Do this for MEI and MIDI (and mixed) inputs.
    • Do this for ACE XML, ARFF and CSV outputs.
    • Do for all features as well as only for 1-D features.
    • Do this windowed and not windowed extraction.
  • Verify that all features in manual are being extracted (including the two MEI ones) once and only once.
    • Verify that there are the correct number of total features are being extracted.
    • Verify that features are being saved in the correct order.
    • Verify that feature values are actually being saved under correct feature labels.
  • Check feature values for general mathematical reasonableness
    • Verify that not getting feature values of NaN, infinity, null or -# (unless there is no better default alternative).
    • Verify that there is reasonable variance in the values of each feature.
    • Check for massive outliers.
    • Check instances with a Range value of 0 (could be OK if only contains unpitched instruments or no notes, but make sure).
    • Check a unpitched percussion-only track to make sure that it isn't getting any false pitches (e.g. MIDI_SLAC\Rap - Pop Rap\Run DMC - Sucka MCs.mid).
  • Verify that features are being extracted from all input files.
    • Check for error messages thrown by jSymbolic.
    • Check feature files have correct number of instances (i.e. no missed exceptions).
  • Verify that feature values are musicologically correct.
    • Make sure manual descriptions were correctly interpreted
    • Compare to old jSymbolic1 feature results to new jSymbolic2 values
    • Will need to hand cacluculate feature values from custom MIDI amd MEI files in order to verify them all

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions