Move to Python 3.10

[ChasNelson1990]

Update the repo to use Python 3.10 everywhere - this means pipenv, docker, everywhere.

[A-Souhei]

Python 3.10 and CKAN 2.11.4 Migration

Overview

This PR migrates the ADX project from Python 3.x to Python 3.10 and from CKAN 2.9.x to CKAN 2.11.4. This is a major upgrade that addresses breaking changes in Python, Flask, SQLAlchemy, and CKAN core APIs.

Branch

update-to-python-3-10

Summary of Changes

Core Upgrades

• Python: 3.x → 3.10
• CKAN: 2.9.x → 2.11.4
• Flask: 1.x → 3.0.3
• SQLAlchemy: 1.3.x → 1.4.52
• Werkzeug: 2.x → 3.0.6

Modified Repositories

Main Project

• adx_develop - Updated submodule references and configuration

CKAN Extensions (8 repositories)

1. ckanext-unaids (3 commits)
   - Fixed infinite recursion in user identification for CKAN 2.11.4
   - Fixed SQLAlchemy 1.4 compatibility in dataset_transfer
   - Updated ReclineView → DataTablesView migration
2. ckanext-emailasusername (1 commit)
   - Fixed User.by_email() None return handling for CKAN 2.11.4
3. ckanext-harvest (1 commit)
   - Fixed SQLAlchemy 1.4 compatibility: replaced table.exists() with inspector.has_table()
4. ckanext-versions (3 commits)
   - Fixed SQLAlchemy 1.4 compatibility
   - Added None engine handling during early startup
   - Used SQLAlchemy Inspector for table existence checks
5. ckanext-restricted (1 commit)
   - Fixed AnonymousUser handling for CKAN 2.11.4 Flask-Login compatibility
6. ckanext-validation (1 commit)
   - Fixed SQLAlchemy 1.4 compatibility
7. ckanext-ytp-request (1 commit)
   - Fixed CKAN 2.11.4 model import compatibility
8. ckanext-blob-storage (1 commit)
   - Fixed setup.py version import

Third-Party Extensions (Forked to adx-tmp)

9. ckanext-pages - SQLAlchemy 1.4 compatibility fix
10. ckanext-authz-service - Python 3.10 compatibility fix (collections.abc)

Migration Documentation

Full migration notes available in: PYTHON310_CKAN2114_MIGRATION.md

[A-Souhei]

I have made 2 submodules fork at https://github.com/orgs/adx-tmp/repositories. This is a draft work but we will use our Fjelltopp fork.
There is much more to check and fix.
@ChasNelson1990

[cooper667]

Fwiw the minimum k8s version on AKS is now 1.32.0 (we used 1.29.0 before, and I think AWS was 1.24.0). I'm trying 1.34.1, so we should try to match that anywhere relevant (assuming it works!)

[cooper667]

Also, we use Postgres 12 here, 13 in cloud (i think). Latest is 18 and azure wont support 13 after March (not entirely our problem but we should use a better version while we're here)

[ChasNelson1990]

Discussed with Craig that we should use Postgres 16