Update XNNPACK usage in Vulkan reference tests #204

Job	Run time
Get changed files / get-changed-files	3s
CI run decision / decide	32s
build-vulkan-windows-msvc / windows-job	15m 23s
test-vulkan-nvidia / linux-job	37m 16s
	53m 14s

Provide feedback