We've been doing scaling erroneously using a scaler for each lat/lon location, rather than a scaler per feature/label.