smoke-test: sort latest versions using the semver format

[v1v]

Motivation/summary

sort in jq does not sort by number.

sort_by is the alternative but to do so it's required to do some transformation when sorting SNAPSHOTS.

This should help with running the smoke tests against the latest versions rather than the latest non-semver which points to 8.9.2

Checklist

• Update CHANGELOG.asciidoc
• Update package changelog.yml (only if changes to apmpackage have been made)
• Documentation has been updated

For functional changes, consider:

• Is it observable through the addition of either logging or metrics?
• Is its use being published in telemetry to enable product improvement?
• Have system tests been added to avoid regression?

How to test these changes

You can run it locally by downloading the JSON file with all the versions:

$  curl -H "Authorization: ApiKey ${EC_API_KEY}" \
  "https://cloud.elastic.co/api/v1/regions/gcp-us-west2/stack/versions?show_deleted=false&show_unusable=false" > f.json

Then

$ cat f.json \
  | jq -r -c '[.stacks[].version | select(. | contains("-SNAPSHOT"))] | sort' | sed 's#-SNAPSHOT#.0#g' \
  | jq -r -c ' sort_by(.| split(".") | map(tonumber))' \
  | sed 's#.0"#-SNAPSHOT"#g' \
  | jq -r -c .
["6.8.19-SNAPSHOT","6.8.20-SNAPSHOT", ..."8.11.3-SNAPSHOT","8.12.0-SNAPSHOT","8.13.0-SNAPSHOT"]

and

$ cat f.json | jq -r -c '[.stacks[].version | select(. | contains("-")) |= gsub("-.*"; "")] | sort_by(.| split(".") | map(tonumber))'
["5.5.1","5.5.2"," ...."8.11.3","8.11.3","8.12.0","8.12.0","8.13.0"]

Then, in the CI itself, I ran the workflow using a Test branch called test/latest-version-smoke-tests - the one that contains these changes plus some minor changes in the GitHub workflow.

This build is the one running against the above-mentioned branch.

This GH job is using the latest snapshot:

This GH job is using the latest release:

Related issues