Fedora: Sudden Memory Spike and Failed Start Up

[matdave]

I've been using ddev without issue. I hadn't touched this project in about two weeks, when I ran ddev start I am getting:

Failed waiting for web/db containers to become ready: db container failed: log=, err=health check timed out after 2m0s

During that time my CPU and RAM usage spike to 100%. I know the first time I ran ddev start it said something about me using a new version (1.24.8) and asked me to run some updates.

The only error in the logs I can see is

 {
      "Start": "2025-10-06T13:36:59.036044074-05:00",
      "End": "2025-10-06T13:39:32.625229954-05:00",
      "ExitCode": -1,
      "Output": "timed out starting health check for container acc8215dc59b430efaa9832e70a452ea5f3461789a21c912b92feab6cea4119e"
    }

[rfay]

Your DB container failed. It gives you the commands to look at there.

Please provide these things (which were shown in your ddev start failure:

ddev logs -s db
docker inspect --format "{{ json .State.Health }}" ddev-<projectname>-db | docker run -i --rm ddev/ddev-utilities jq -r

And please provide the file output by ddev debug test, or give it as a gist.

[matdave]

+ set -eu
+ set -o pipefail
+ export DATADIR=/var/lib/mysql
+ DATADIR=/var/lib/mysql
+ echo BITNAMI_VOLUME_DIR=notset
BITNAMI_VOLUME_DIR=notset
+ SOCKET=/var/tmp/mysql.sock
+ '[' '' = mysql ']'
+ rm -f /tmp/healthy
+ export BACKUPTOOL=mariabackup
+ BACKUPTOOL=mariabackup
+ export STREAMTOOL=mbstream
+ STREAMTOOL=mbstream
+ command -v xtrabackup
+ BACKUPTOOL=xtrabackup
+ STREAMTOOL=xbstream
+ '[' '!' -d /mnt/snapshots ']'
+ '[' 0 = 2 ']'
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/local/bin:/usr/local/mysql/bin
+ mysqld -V
+ awk '{print $3}'
++ awk -F- '{ sub( /\.[0-9]+(-.*)?$/, "", $1); server_type="mysql"; if ($2 ~ /^MariaDB/) { server_type="mariadb" }; print server_type "_" $1 }' /tmp/raw_mysql_version.txt
+ server_db_version=mysql_5.7
+ rm -f /tmp/raw_mysql_version.txt
+ '[' -d /mnt/ddev_config/mysql ']'
++ echo '/mnt/ddev_config/mysql/*.cnf'
+ '[' '/mnt/ddev_config/mysql/*.cnf' '!=' '/mnt/ddev_config/mysql/*.cnf' ']'
+ CONFIG_DIR=/etc/mysql/version-conf.d
+ DB_TYPE=mysql
+ DB_VERSION=5.7
+ DB_MAJOR_VERSION=5
+ DB_BASE=mysql_5
Initializing version-specific configuration for mysql_5.7...
+ echo 'Initializing version-specific configuration for mysql_5.7...'
+ mkdir -p /etc/mysql/version-conf.d
+ BEST_MATCH=
+ '[' -f /etc/mysql/version-conf.d/mysql_5.7.cnf.txt ']'
+ '[' -f /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ BEST_MATCH=/etc/mysql/version-conf.d/mysql_5.cnf.txt
+ '[' -n /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ ln -sf /etc/mysql/version-conf.d/mysql_5.cnf.txt /etc/mysql/version-conf.d/mysql_5.cnf
Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf
+ echo 'Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf'
+ '[' '!' -f /var/lib/mysql/db_mariadb_version.txt ']'
++ cat /var/lib/mysql/db_mariadb_version.txt
+ database_db_version=mysql_5.7
+ '[' 5.7 = mysql_5.7 ']'
+ '[' mysql_5.7 '!=' mysql_5.7 ']'
+ echo mysql_5.7
+ mkdir -p /mnt/ddev-global-cache/bashhistory/sentinel.modx-db /mnt/ddev-global-cache/mysqlhistory/sentinel.modx-db
+ printf ''

MySQL init process done. Ready for start up.

Starting mysqld.
+ echo
+ echo 'MySQL init process done. Ready for start up.'
+ echo
+ echo 'Starting mysqld.'
+ exec mysqld --server-id=0
+ tail -f /var/log/mysqld.log /var/lib/mysql/mysqld.err
==> /var/log/mysqld.log <==

==> /var/lib/mysql/mysqld.err <==
+ set -eu
+ set -o pipefail
+ export DATADIR=/var/lib/mysql
+ DATADIR=/var/lib/mysql
+ echo BITNAMI_VOLUME_DIR=notset
BITNAMI_VOLUME_DIR=notset
+ SOCKET=/var/tmp/mysql.sock
+ '[' '' = mysql ']'
+ rm -f /tmp/healthy
+ export BACKUPTOOL=mariabackup
+ BACKUPTOOL=mariabackup
+ export STREAMTOOL=mbstream
+ STREAMTOOL=mbstream
+ command -v xtrabackup
+ BACKUPTOOL=xtrabackup
+ STREAMTOOL=xbstream
+ '[' '!' -d /mnt/snapshots ']'
+ '[' 0 = 2 ']'
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/local/bin:/usr/local/mysql/bin
+ mysqld -V
+ awk '{print $3}'
++ awk -F- '{ sub( /\.[0-9]+(-.*)?$/, "", $1); server_type="mysql"; if ($2 ~ /^MariaDB/) { server_type="mariadb" }; print server_type "_" $1 }' /tmp/raw_mysql_version.txt
+ server_db_version=mysql_5.7
+ rm -f /tmp/raw_mysql_version.txt
+ '[' -d /mnt/ddev_config/mysql ']'
++ echo '/mnt/ddev_config/mysql/*.cnf'
+ '[' '/mnt/ddev_config/mysql/*.cnf' '!=' '/mnt/ddev_config/mysql/*.cnf' ']'
+ CONFIG_DIR=/etc/mysql/version-conf.d
+ DB_TYPE=mysql
+ DB_VERSION=5.7
+ DB_MAJOR_VERSION=5
+ DB_BASE=mysql_5
Initializing version-specific configuration for mysql_5.7...
+ echo 'Initializing version-specific configuration for mysql_5.7...'
+ mkdir -p /etc/mysql/version-conf.d
+ BEST_MATCH=
+ '[' -f /etc/mysql/version-conf.d/mysql_5.7.cnf.txt ']'
+ '[' -f /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ BEST_MATCH=/etc/mysql/version-conf.d/mysql_5.cnf.txt
+ '[' -n /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ ln -sf /etc/mysql/version-conf.d/mysql_5.cnf.txt /etc/mysql/version-conf.d/mysql_5.cnf
+ echo 'Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf'
Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf
+ '[' '!' -f /var/lib/mysql/db_mariadb_version.txt ']'
++ cat /var/lib/mysql/db_mariadb_version.txt
+ database_db_version=mysql_5.7
+ '[' 5.7 = mysql_5.7 ']'
+ '[' mysql_5.7 '!=' mysql_5.7 ']'
+ echo mysql_5.7
+ mkdir -p /mnt/ddev-global-cache/bashhistory/sentinel.modx-db /mnt/ddev-global-cache/mysqlhistory/sentinel.modx-db
+ printf ''

+ echo
+ echo 'MySQL init process done. Ready for start up.'
+ echo
+ echo 'Starting mysqld.'
MySQL init process done. Ready for start up.

Starting mysqld.
+ exec mysqld --server-id=0
+ tail -f /var/log/mysqld.log /var/lib/mysql/mysqld.err
==> /var/log/mysqld.log <==

==> /var/lib/mysql/mysqld.err <==
BITNAMI_VOLUME_DIR=notset
+ set -eu
+ set -o pipefail
+ export DATADIR=/var/lib/mysql
+ DATADIR=/var/lib/mysql
+ echo BITNAMI_VOLUME_DIR=notset
+ SOCKET=/var/tmp/mysql.sock
+ '[' '' = mysql ']'
+ rm -f /tmp/healthy
+ export BACKUPTOOL=mariabackup
+ BACKUPTOOL=mariabackup
+ export STREAMTOOL=mbstream
+ STREAMTOOL=mbstream
+ command -v xtrabackup
+ BACKUPTOOL=xtrabackup
+ STREAMTOOL=xbstream
+ '[' '!' -d /mnt/snapshots ']'
+ '[' 0 = 2 ']'
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/local/bin:/usr/local/mysql/bin
+ mysqld -V
+ awk '{print $3}'
++ awk -F- '{ sub( /\.[0-9]+(-.*)?$/, "", $1); server_type="mysql"; if ($2 ~ /^MariaDB/) { server_type="mariadb" }; print server_type "_" $1 }' /tmp/raw_mysql_version.txt
+ server_db_version=mysql_5.7
+ rm -f /tmp/raw_mysql_version.txt
+ '[' -d /mnt/ddev_config/mysql ']'
++ echo '/mnt/ddev_config/mysql/*.cnf'
+ '[' '/mnt/ddev_config/mysql/*.cnf' '!=' '/mnt/ddev_config/mysql/*.cnf' ']'
+ CONFIG_DIR=/etc/mysql/version-conf.d
+ DB_TYPE=mysql
+ DB_VERSION=5.7
+ DB_MAJOR_VERSION=5
+ DB_BASE=mysql_5
+ echo 'Initializing version-specific configuration for mysql_5.7...'
+ mkdir -p /etc/mysql/version-conf.d
Initializing version-specific configuration for mysql_5.7...
+ BEST_MATCH=
+ '[' -f /etc/mysql/version-conf.d/mysql_5.7.cnf.txt ']'
+ '[' -f /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ BEST_MATCH=/etc/mysql/version-conf.d/mysql_5.cnf.txt
+ '[' -n /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ ln -sf /etc/mysql/version-conf.d/mysql_5.cnf.txt /etc/mysql/version-conf.d/mysql_5.cnf
+ echo 'Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf'
Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf
+ '[' '!' -f /var/lib/mysql/db_mariadb_version.txt ']'
++ cat /var/lib/mysql/db_mariadb_version.txt
+ database_db_version=mysql_5.7
+ '[' 5.7 = mysql_5.7 ']'
+ '[' mysql_5.7 '!=' mysql_5.7 ']'
+ echo mysql_5.7
+ mkdir -p /mnt/ddev-global-cache/bashhistory/sentinel.modx-db /mnt/ddev-global-cache/mysqlhistory/sentinel.modx-db
+ printf ''

MySQL init process done. Ready for start up.

Starting mysqld.
+ echo
+ echo 'MySQL init process done. Ready for start up.'
+ echo
+ echo 'Starting mysqld.'
+ exec mysqld --server-id=0
+ tail -f /var/log/mysqld.log /var/lib/mysql/mysqld.err
==> /var/log/mysqld.log <==

==> /var/lib/mysql/mysqld.err <==
BITNAMI_VOLUME_DIR=notset
+ set -eu
+ set -o pipefail
+ export DATADIR=/var/lib/mysql
+ DATADIR=/var/lib/mysql
+ echo BITNAMI_VOLUME_DIR=notset
+ SOCKET=/var/tmp/mysql.sock
+ '[' '' = mysql ']'
+ rm -f /tmp/healthy
+ export BACKUPTOOL=mariabackup
+ BACKUPTOOL=mariabackup
+ export STREAMTOOL=mbstream
+ STREAMTOOL=mbstream
+ command -v xtrabackup
+ BACKUPTOOL=xtrabackup
+ STREAMTOOL=xbstream
+ '[' '!' -d /mnt/snapshots ']'
+ '[' 0 = 2 ']'
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/local/bin:/usr/local/mysql/bin
+ mysqld -V
+ awk '{print $3}'
++ awk -F- '{ sub( /\.[0-9]+(-.*)?$/, "", $1); server_type="mysql"; if ($2 ~ /^MariaDB/) { server_type="mariadb" }; print server_type "_" $1 }' /tmp/raw_mysql_version.txt
+ server_db_version=mysql_5.7
+ rm -f /tmp/raw_mysql_version.txt
+ '[' -d /mnt/ddev_config/mysql ']'
++ echo '/mnt/ddev_config/mysql/*.cnf'
+ '[' '/mnt/ddev_config/mysql/*.cnf' '!=' '/mnt/ddev_config/mysql/*.cnf' ']'
+ CONFIG_DIR=/etc/mysql/version-conf.d
+ DB_TYPE=mysql
+ DB_VERSION=5.7
+ DB_MAJOR_VERSION=5
+ DB_BASE=mysql_5
+ echo 'Initializing version-specific configuration for mysql_5.7...'
+ mkdir -p /etc/mysql/version-conf.d
Initializing version-specific configuration for mysql_5.7...
+ BEST_MATCH=
+ '[' -f /etc/mysql/version-conf.d/mysql_5.7.cnf.txt ']'
+ '[' -f /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ BEST_MATCH=/etc/mysql/version-conf.d/mysql_5.cnf.txt
+ '[' -n /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ ln -sf /etc/mysql/version-conf.d/mysql_5.cnf.txt /etc/mysql/version-conf.d/mysql_5.cnf
+ echo 'Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf'
Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf
+ '[' '!' -f /var/lib/mysql/db_mariadb_version.txt ']'
++ cat /var/lib/mysql/db_mariadb_version.txt
+ database_db_version=mysql_5.7
+ '[' 5.7 = mysql_5.7 ']'
+ '[' mysql_5.7 '!=' mysql_5.7 ']'
+ echo mysql_5.7
+ mkdir -p /mnt/ddev-global-cache/bashhistory/sentinel.modx-db /mnt/ddev-global-cache/mysqlhistory/sentinel.modx-db
+ printf ''

MySQL init process done. Ready for start up.
+ echo
+ echo 'MySQL init process done. Ready for start up.'

Starting mysqld.
+ echo
+ echo 'Starting mysqld.'
+ exec mysqld --server-id=0
+ tail -f /var/log/mysqld.log /var/lib/mysql/mysqld.err
==> /var/log/mysqld.log <==

==> /var/lib/mysql/mysqld.err <==
+ set -eu
+ set -o pipefail
+ export DATADIR=/var/lib/mysql
+ DATADIR=/var/lib/mysql
+ echo BITNAMI_VOLUME_DIR=notset
+ SOCKET=/var/tmp/mysql.sock
BITNAMI_VOLUME_DIR=notset
+ '[' '' = mysql ']'
+ rm -f /tmp/healthy
+ export BACKUPTOOL=mariabackup
+ BACKUPTOOL=mariabackup
+ export STREAMTOOL=mbstream
+ STREAMTOOL=mbstream
+ command -v xtrabackup
+ BACKUPTOOL=xtrabackup
+ STREAMTOOL=xbstream
+ '[' '!' -d /mnt/snapshots ']'
+ '[' 0 = 2 ']'
+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/sbin:/usr/local/bin:/usr/local/mysql/bin
+ mysqld -V
+ awk '{print $3}'
++ awk -F- '{ sub( /\.[0-9]+(-.*)?$/, "", $1); server_type="mysql"; if ($2 ~ /^MariaDB/) { server_type="mariadb" }; print server_type "_" $1 }' /tmp/raw_mysql_version.txt
+ server_db_version=mysql_5.7
+ rm -f /tmp/raw_mysql_version.txt
+ '[' -d /mnt/ddev_config/mysql ']'
++ echo '/mnt/ddev_config/mysql/*.cnf'
+ '[' '/mnt/ddev_config/mysql/*.cnf' '!=' '/mnt/ddev_config/mysql/*.cnf' ']'
+ CONFIG_DIR=/etc/mysql/version-conf.d
+ DB_TYPE=mysql
+ DB_VERSION=5.7
+ DB_MAJOR_VERSION=5
+ DB_BASE=mysql_5
+ echo 'Initializing version-specific configuration for mysql_5.7...'
Initializing version-specific configuration for mysql_5.7...
+ mkdir -p /etc/mysql/version-conf.d
+ BEST_MATCH=
+ '[' -f /etc/mysql/version-conf.d/mysql_5.7.cnf.txt ']'
+ '[' -f /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ BEST_MATCH=/etc/mysql/version-conf.d/mysql_5.cnf.txt
+ '[' -n /etc/mysql/version-conf.d/mysql_5.cnf.txt ']'
+ ln -sf /etc/mysql/version-conf.d/mysql_5.cnf.txt /etc/mysql/version-conf.d/mysql_5.cnf
Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf
+ echo 'Linked /etc/mysql/version-conf.d/mysql_5.cnf.txt -> /etc/mysql/version-conf.d/mysql_5.cnf'
+ '[' '!' -f /var/lib/mysql/db_mariadb_version.txt ']'
++ cat /var/lib/mysql/db_mariadb_version.txt
+ database_db_version=mysql_5.7
+ '[' 5.7 = mysql_5.7 ']'
+ '[' mysql_5.7 '!=' mysql_5.7 ']'
+ echo mysql_5.7
+ mkdir -p /mnt/ddev-global-cache/bashhistory/sentinel.modx-db /mnt/ddev-global-cache/mysqlhistory/sentinel.modx-db
+ printf ''
+ echo

MySQL init process done. Ready for start up.

Starting mysqld.
+ echo 'MySQL init process done. Ready for start up.'
+ echo
+ echo 'Starting mysqld.'
+ exec mysqld --server-id=0
+ tail -f /var/log/mysqld.log /var/lib/mysql/mysqld.err
==> /var/log/mysqld.log <==

==> /var/lib/mysql/mysqld.err <==

docker inspect --format "{{ json .State.Health }}" ddev-sentinel.modx-db | docker run -i --rm ddev/ddev-utilities jq -r
{
  "Status": "unhealthy",
  "FailingStreak": 0,
  "Log": [
    {
      "Start": "2025-10-06T14:35:05.874414197-05:00",
      "End": "2025-10-06T14:35:05.982980311-05:00",
      "ExitCode": 1,
      "Output": "mysql: [Warning] Using a password on the command line interface can be insecure.\nERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1' (111)\n"
    },
    {
      "Start": "2025-10-06T14:35:06.983723153-05:00",
      "End": "2025-10-06T14:35:07.088807768-05:00",
      "ExitCode": 1,
      "Output": "mysql: [Warning] Using a password on the command line interface can be insecure.\nERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1' (111)\n"
    },
    {
      "Start": "2025-10-06T14:35:08.090284965-05:00",
      "End": "2025-10-06T14:35:08.184182872-05:00",
      "ExitCode": 1,
      "Output": "mysql: [Warning] Using a password on the command line interface can be insecure.\nERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1' (111)\n"
    },
    {
      "Start": "2025-10-06T14:35:09.185266311-05:00",
      "End": "2025-10-06T14:35:09.260853443-05:00",
      "ExitCode": 1,
      "Output": "mysql: [Warning] Using a password on the command line interface can be insecure.\nERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1' (111)\n"
    },
    {
      "Start": "2025-10-06T14:35:10.268614688-05:00",
      "End": "2025-10-06T14:35:15.036917501-05:00",
      "ExitCode": 1,
      "Output": "mysql: [Warning] Using a password on the command line interface can be insecure.\nERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1' (111)\n"
    }
  ]
}

[matdave]

Here's the debug test log https://gist.github.com/matdave/04c499774b6c072d221f376b92f8579a

[rfay]

Thanks for the info. I see that the test project works fine.

Could you please create a trivial project with the mysql:5.7 database type and see if it has any trouble?

mkdir junk && cd junk
ddev config --database=mysql:5.7
ddev start

If that works fine, do you have a backup of your database? (ddev export-db, or ddev snapshot or upstream version ?
If so, please ddev delete -Oy && ddev start. This will delete your database.

[matdave]

I get the same thing on junk

[matdave]

As a test I tried creating a junk84 project with mysql:8.4 and it was fine. It appears to just be mysql:5.7 giving me issues. Unfortunately, I can't run the upgrade because i can't start the damn thing.

[stasadev]

See:

• MySQL 5.6/5.7 configured in DDEV is using 100% RAM or getting killed (ddev start fails) #4862

[rfay]

Ah, Fedora, Fedora...

[matdave]

Thanks, adjusting that seemed to fix it. Strange that it was working fine.