Arm backend: Fix vgf_quant swin test op-count and test vgf models in … #6447

Job	Run time
test-xnnpack / test-backend-linux (xnnpack_static_int8_per_channel, operators) / linux-job	26m 59s
test-xnnpack / test-backend-linux (xnnpack_dynamic_int8_per_channel, models) / linux-job	17m 26s
test-xnnpack / test-backend-linux (xnnpack_dynamic_int8_per_channel, operators) / linux-job	19m 25s
test-xnnpack / test-backend-linux (xnnpack_static_int8_per_tensor, models) / linux-job	23m 17s
test-xnnpack / test-backend-linux (xnnpack_static_int8_per_tensor, operators) / linux-job	26m 49s
test-xnnpack / test-backend-linux (xnnpack, models) / linux-job	20m 27s
test-xnnpack / test-backend-linux (xnnpack, operators) / linux-job	14m 50s
test-xnnpack / test-backend-linux (xnnpack_static_int8_per_channel, models) / linux-job	24m 2s
test-xnnpack / test-backend-macos	0s
test-xnnpack / package-golden-artifacts	6m 5s
	2h 59m 20s

Provide feedback