Job for slurmctld.service failed because the control process exited with error code.
See "systemctl status slurmctld.service" and "journalctl -xeu slurmctld.service" for details.
slurm_load_partitions: Unable to contact slurm controller (connect failure)
× slurmctld.service - Slurm controller daemon
     Loaded: loaded (/usr/lib/systemd/system/slurmctld.service; enabled; preset: enabled)
     Active: failed (Result: exit-code) since Thu 2024-10-10 07:42:39 UTC; 9s ago
       Docs: man:slurmctld(8)
    Process: 3866 ExecStart=/usr/sbin/slurmctld --systemd $SLURMCTLD_OPTIONS (code=exited, status=1/FAILURE)
   Main PID: 3866 (code=exited, status=1/FAILURE)
        CPU: 2ms
Oct 10 07:42:39 fv-az1950-264 systemd[1]: Starting slurmctld.service - Slurm controller daemon...
Oct 10 07:42:39 fv-az1950-264 (lurmctld)[3866]: slurmctld.service: Referenced but unset environment variable evaluates to an empty string: SLURMCTLD_OPTIONS
Oct 10 07:42:39 fv-az1950-264 slurmctld[3866]: slurmctld: fatal: Incorrect permissions on state save loc: /var/spool
Oct 10 07:42:39 fv-az1950-264 systemd[1]: slurmctld.service: Main process exited, code=exited, status=1/FAILURE
Oct 10 07:42:39 fv-az1950-264 systemd[1]: slurmctld.service: Failed with result 'exit-code'.
Oct 10 07:42:39 fv-az1950-264 systemd[1]: Failed to start slurmctld.service - Slurm controller daemon.
Oct 10 07:42:25 fv-az1950-264 systemd[1]: slurmctld.service - Slurm controller daemon was skipped because of an unmet condition check (ConditionPathExists=/etc/slurm/slurm.conf).
░░ Subject: A start job for unit slurmctld.service has finished successfully
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░ 
░░ A start job for unit slurmctld.service has finished successfully.
░░ 
░░ The job identifier is 1691.
Oct 10 07:42:39 fv-az1950-264 systemd[1]: Starting slurmctld.service - Slurm controller daemon...
░░ Subject: A start job for unit slurmctld.service has begun execution
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░ 
░░ A start job for unit slurmctld.service has begun execution.
░░ 
░░ The job identifier is 2072.
Oct 10 07:42:39 fv-az1950-264 (lurmctld)[3866]: slurmctld.service: Referenced but unset environment variable evaluates to an empty string: SLURMCTLD_OPTIONS
Oct 10 07:42:39 fv-az1950-264 slurmctld[3866]: slurmctld: fatal: Incorrect permissions on state save loc: /var/spool
Oct 10 07:42:39 fv-az1950-264 systemd[1]: slurmctld.service: Main process exited, code=exited, status=1/FAILURE
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░ 
░░ An ExecStart= process belonging to unit slurmctld.service has exited.
░░ 
░░ The process' exit code is 'exited' and its exit status is 1.
Oct 10 07:42:39 fv-az1950-264 systemd[1]: slurmctld.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░ 
░░ The unit slurmctld.service has entered the 'failed' state with result 'exit-code'.
Oct 10 07:42:39 fv-az1950-264 systemd[1]: Failed to start slurmctld.service - Slurm controller daemon.
░░ Subject: A start job for unit slurmctld.service has failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░ 
░░ A start job for unit slurmctld.service has finished with a failure.
░░ 
░░ The job identifier is 2072 and the job result is failed.