When prompted by the Built Tools for Visual Studio installer, you need to install the C++ build tools only.
You must install the full "Windows 10 SDK" package as the SDK will need to build the pioasm and elf2uf2 tools locally. Removing it from the list of installed items will mean that you will be unable to build Raspberry Pi Pico binaries.