Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QGIS crashed while loading a lot of layers into a group from the python console #60129

Open
1 of 2 tasks
donharter opened this issue Jan 13, 2025 · 2 comments
Open
1 of 2 tasks
Labels
Bug Either a bug report, or a bug fix. Let's hope for the latter! Crash/Data Corruption

Comments

@donharter
Copy link

donharter commented Jan 13, 2025

What is the bug or the crash?

I am loading a lot of layers using a script that I wrote for the python console. It has worked before. It starts loading layers but then crashes. About when it crashes I see a message that all of the layers have an unrecognized format. That isn't true, because I can load them manually. They are all dem .tif files generated from LIDAR data. They may have some nodata areas. Maybe that is an issue, but it crashes qgis completely.

Steps to reproduce the issue

  1. highlight the group where you want the layers to be added to. Usually I copy the style from a current member so that I can apply it to the new layers.
  2. run this script in the python console editor
  3. import os
    from qgis.core import QgsMapLayer
    os.chdir("/home/drh/gis/lidar/ut_skinwalker")
    for x in os.listdir():
    if x.endswith(".dem.tif"):
    # load as layer in the contour group
    layer = QgsProject.instance().mapLayersByName(x)
    if len(layer) == 0:
    iface.addRasterLayer(x, x)
    print(x)
    It will seemingly load about 100 layers OK then I get the message about invalid files and the whole qgis crashes.

Versions

<style type="text/css"> p, li { white-space: pre-wrap; } </style>
QGIS version 3.40.2-Bratislava
QGIS code revision 14826ca
 
Libraries
Qt version 5.15.8
Python version 3.11.2
GDAL/OGR version 3.6.2
PROJ version 9.1.1
EPSG Registry database version v10.076 (2022-08-31)
GEOS version 3.11.1-CAPI-1.17.1
SQLite version 3.40.1
PostgreSQL client version 15.8 (Debian 15.8-0+deb12u1)
SpatiaLite version 5.0.1
QWT version 6.1.4
QScintilla2 version 2.13.3
OS version LMDE 6 (faye)
 
Active Python plugins
qfieldsync v4.12.1
LAStools 2.1.1
qgsAzimuth 0.9.19
Serval 3.32.0
rvt-qgis 0.9.6
OSMDownloader 1.0.3
poiexport 3.0.5
pdaltools 0.1.6
AzimuthMeasurement 0.2.2
wbt_for_qgis 1.0.9
AzimuthDistanceCalculator 2.0.2
osminfo 1.1.0
locationiq-qgis 3.0.6
open_lidar_tools 2.3
processing_saga_nextgen 1.0.0
DigitizingTools 1.5.2
openlayers_plugin 2.0.0
pobieracz_danych_gugik 1.2.7
contour 2.0.14
loadthemall 3.4
batch_hillshader-master 2.4.4
SpreadsheetLayers 2.1.2
latlontools 3.7.2
multiqml 0.7.0
valuetool 3.0.19
MetaSearch 0.3.6
db_manager 0.1.20
processing 2.12.99
grassprovider 2.12.99
QGIS version 3.40.2-Bratislava QGIS code revision [14826ca](https://github.com/qgis/QGIS/commit/14826ca1e4a)

Libraries
Qt version
5.15.8
Python version
3.11.2
GDAL/OGR version
3.6.2
PROJ version
9.1.1
EPSG Registry database version
v10.076 (2022-08-31)
GEOS version
3.11.1-CAPI-1.17.1
SQLite version
3.40.1
PostgreSQL client version
15.8 (Debian 15.8-0+deb12u1)
SpatiaLite version
5.0.1
QWT version
6.1.4
QScintilla2 version
2.13.3
OS version
LMDE 6 (faye)

Active Python plugins
qfieldsync
v4.12.1
LAStools
2.1.1
qgsAzimuth
0.9.19
Serval
3.32.0
rvt-qgis
0.9.6
OSMDownloader
1.0.3
poiexport
3.0.5
pdaltools
0.1.6
AzimuthMeasurement
0.2.2
wbt_for_qgis
1.0.9
AzimuthDistanceCalculator
2.0.2
osminfo
1.1.0
locationiq-qgis
3.0.6
open_lidar_tools
2.3
processing_saga_nextgen
1.0.0
DigitizingTools
1.5.2
openlayers_plugin
2.0.0
pobieracz_danych_gugik
1.2.7
contour
2.0.14
loadthemall
3.4
batch_hillshader-master
2.4.4
SpreadsheetLayers
2.1.2
latlontools
3.7.2
multiqml
0.7.0
valuetool
3.0.19
MetaSearch
0.3.6
db_manager
0.1.20
processing
2.12.99
grassprovider
2.12.99

Supported QGIS version

  • I'm running a supported QGIS version according to the roadmap.

New profile

Additional context

2025-01-13T08:06:39.875945-05:00 lnx03 systemd[1]: Started [email protected] - Process Core Dump (PID 7897/UID 0).
2025-01-13T08:06:47.814895-05:00 lnx03 systemd-coredump[7898]: Process 7624 (qgis.bin) of user 1000 dumped core.#12#012Module libnss_my
hostname.so.2 from deb systemd-252.33-1deb12u1.amd64#012Module libsystemd.so.0 from deb systemd-252.33-1deb12u1.amd64#012Module libude
v.so.1 from deb systemd-252.33-1~deb12u1.amd64#012Stack trace of thread 7882:#12#0 0x00007fb92a0a9ebc __pthread_kill_implementation (l
ibc.so.6 + 0x8aebc)#12#1 0x00007fb92a05afb2 __GI_raise (libc.so.6 + 0x3bfb2)#12#2 0x00007fb92a05b050 __restore_rt (libc.so.6 + 0x3c0
50)#12#3 0x00007fb92a0a9ebc __pthread_kill_implementation (libc.so.6 + 0x8aebc)#12#4 0x00007fb92a05afb2 __GI_raise (libc.so.6 + 0x3b
fb2)#12#5 0x00007fb92a045472 __GI_abort (libc.so.6 + 0x26472)#12#6 0x00005584399600e6 n/a (qgis.bin + 0x120e6)#12#7 0x00007fb92a05
b050 __restore_rt (libc.so.6 + 0x3c050)#12#8 0x00007fb923b237d7 g_log_structured_array (libglib-2.0.so.0 + 0x5b7d7)#12#9 0x00007fb923b23bfe g_log_default_handler (libglib-2.0.so.0 + 0x5bbfe)#12#10 0x00007fb923b23e67 g_logv (libglib-2.0.so.0 + 0x5be67)#12#11 0x00007fb923b240ff g_log (libglib-2.0.so.0 + 0x5c0ff)#12#12 0x00007fb923b6bc52 n/a (libglib-2.0.so.0 + 0xa3c52)#12#13 0x00007fb923b19598 g_main_context_new_with_flags (libglib-2.0.so.0 + 0x51598)#12#14 0x00007fb92cb0a139 _ZN27QEventDispatcherGlibPrivateC2EP13_GMainContext (libQt5Core.so.5 + 0x30a139)#12#15 0x00007fb92cb0a1d1 _ZN20QEventDispatcherGlibC1EP7QObject (libQt5Core.so.5 + 0x30a1d1)#12#16 0x00007fb92c8cb41f n/a (libQt5Core.so.5 + 0xcb41f)#12#17 0x00007fb92c8ca15e n/a (libQt5Core.so.5 + 0xca15e)#12#18 0x00007fb92c8cbe98 n/a (libQt5Core.so.5 + 0xcbe98)#12#19 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#20 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7639:#12#0 0x00007fb92a11b1df __GI___poll (libc.so.6 + 0xfc1df)#12#1 0x00007fb91ee09d12 n/a (libxcb.so.1 + 0xcd12)#12#2 0x00007fb91ee0c07a xcb_wait_for_event (libxcb.so.1 + 0xf07a)#12#3 0x00007fb8b94faf00 n/a (libQt5XcbQpa.so.5 + 0x6cf00)#12#4 0x00007fb92c8cbd83 n/a (libQt5Core.so.5 + 0xcbd83)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7642:#12#0 0x00007fb92a0a4f16 __futex_abstimed_wait_common64 (libc.so.6 + 0x85f16)#12#1 0x00007fb92a0a75d8 __pthread_cond_wait_common (libc.so.6 + 0x885d8)#12#2 0x00007fb8b1b9dd1d n/a (radeonsi_dri.so + 0x19dd1d)#12#3 0x00007fb8b1b5463b n/a (radeonsi_dri.so + 0x15463b)#12#4 0x00007fb8b1b9dc4b n/a (radeonsi_dri.so + 0x19dc4b)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7640:#12#0 0x00007fb92a11b1df __GI___poll (libc.so.6 + 0xfc1df)#12#1 0x00007fb923b1c9ae n/a (libglib-2.0.so.0 + 0x549ae)#12#2 0x00007fb923b1cacc g_main_context_iteration (libglib-2.0.so.0 + 0x54acc)#12#3 0x00007fb92cb09876 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5 + 0x309876)#12#4 0x00007fb92cab01bb _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5 + 0x2b01bb)#12#5 0x00007fb92c8cabc7 _ZN7QThread4execEv (libQt5Core.so.5 + 0xcabc7)#12#6 0x00007fb9234a5487 n/a (libQt5DBus.so.5 + 0x17487)#12#7 0x00007fb92c8cbd83 n/a (libQt5Core.so.5 + 0xcbd83)#12#8 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#9 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7644:#12#0 0x00007fb92a0a4f16 __futex_abstimed_wait_common64 (libc.so.6 + 0x85f16)#12#1 0x00007fb92a0a75d8 __pthread_cond_wait_common (libc.so.6 + 0x885d8)#12#2 0x00007fb8b1b9dd1d n/a (radeonsi_dri.so + 0x19dd1d)#12#3 0x00007fb8b1b5463b n/a (radeonsi_dri.so + 0x15463b)#12#4 0x00007fb8b1b9dc4b n/a (radeonsi_dri.so + 0x19dc4b)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7645:#12#0 0x00007fb92a0a4f16 __futex_abstimed_wait_common64 (libc.so.6 + 0x85f16)#12#1 0x00007fb92a0a75d8 __pthread_cond_wait_common (libc.so.6 + 0x885d8)#12#2 0x00007fb8b1b9dd1d n/a (radeonsi_dri.so + 0x19dd1d)#12#3 0x00007fb8b1b5463b n/a (radeonsi_dri.so + 0x15463b)#12#4 0x00007fb8b1b9dc4b n/a (radeonsi_dri.so + 0x19dc4b)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7648:#12#0 0x00007fb92a0a4f16 __futex_abstimed_wait_common64 (libc.so.6 + 0x85f16)#12#1 0x00007fb92a0a75d8 __pthread_cond_wait_common (libc.so.6 + 0x885d8)#12#2 0x00007fb8b1b9dd1d n/a (radeonsi_dri.so + 0x19dd1d)#12#3 0x00007fb8b1b5463b n/a (radeonsi_dri.so + 0x15463b)#12#4 0x00007fb8b1b9dc4b n/a (radeonsi_dri.so + 0x19dc4b)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7647:#12#0 0x00007fb92a0a4f16 __futex_abstimed_wait_common64 (libc.so.6 + 0x85f16)#12#1 0x00007fb92a0a75d8 __pthread_cond_wait_common (libc.so.6 + 0x885d8)#12#2 0x00007fb8b1b9dd1d n/a (radeonsi_dri.so + 0x19dd1d)#12#3 0x00007fb8b1b5463b n/a (radeonsi_dri.so + 0x15463b)#12#4 0x00007fb8b1b9dc4b n/a (radeonsi_dri.so + 0x19dc4b)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7646:#12#0 0x00007fb92a0a4f16 __futex_abstimed_wait_common64 (libc.so.6 + 0x85f16)#12#1 0x00007fb92a0a75d8 __pthread_cond_wait_common (libc.so.6 + 0x885d8)#12#2 0x00007fb8b1b9dd1d n/a (radeonsi_dri.so + 0x19dd1d)#12#3 0x00007fb8b1b5463b n/a (radeonsi_dri.so + 0x15463b)#12#4 0x00007fb8b1b9dc4b n/a (radeonsi_dri.so + 0x19dc4b)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7624:#12#0 0x00007fb92a11b1df __GI___poll (libc.so.6 + 0xfc1df)#12#1 0x00007fb923b1c9ae n/a (libglib-2.0.so.0 + 0x549ae)#12#2 0x00007fb923b1cacc g_main_context_iteration (libglib-2.0.so.0 + 0x54acc)#12#3 0x00007fb92cb09876 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5 + 0x309876)#12#4 0x00007fb92cab01bb _ZN10QEventLoop4execE6QFlagsINS_17ProcessEventsFlagEE (libQt5Core.so.5 + 0x2b01bb)#12#5 0x00007fb92cab8316 _ZN16QCoreApplication4execEv (libQt5Core.so.5 + 0x2b8316)#12#6 0x000055843995c897 n/a (qgis.bin + 0xe897)#12#7 0x00007fb92a04624a __libc_start_call_main (libc.so.6 + 0x2724a)#12#8 0x00007fb92a046305 __libc_start_main_impl (libc.so.6 + 0x27305)#12#9 0x000055843995f291 n/a (qgis.bin + 0x11291)#12#012Stack trace of thread 7673:#12#0 0x00007fb92a0a4f16 __futex_abstimed_wait_common64 (libc.so.6 + 0x85f16)#12#1 0x00007fb92a0a75d8 __pthread_cond_wait_common (libc.so.6 + 0x885d8)#12#2 0x00007fb9283a140f n/a (libQt5WebKit.so.5 + 0x21a140f)#12#3 0x00007fb9283a1519 n/a (libQt5WebKit.so.5 + 0x21a1519)#12#4 0x00007fb929ed44a3 n/a (libstdc++.so.6 + 0xd44a3)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7649:#12#0 0x00007fb92a0a4f16 __futex_abstimed_wait_common64 (libc.so.6 + 0x85f16)#12#1 0x00007fb92a0a75d8 __pthread_cond_wait_common (libc.so.6 + 0x885d8)#12#2 0x00007fb8b1b9dd1d n/a (radeonsi_dri.so + 0x19dd1d)#12#3 0x00007fb8b1b5463b n/a (radeonsi_dri.so + 0x15463b)#12#4 0x00007fb8b1b9dc4b n/a (radeonsi_dri.so + 0x19dc4b)#12#5 0x00007fb92a0a81c4 start_thread (libc.so.6 + 0x891c4)#12#6 0x00007fb92a12885c __clone3 (libc.so.6 + 0x10985c)#12#012Stack trace of thread 7667:#12#0 0x00007fb92a11b1df __GI___poll (libc.so.6 + 0xfc1df)#12#1 0x00007fb923b1c9ae n/a (libglib-2.0.so.0 + 0x549ae)#12#2 0x00007fb923b1cacc g_main_context_iteration (libglib-2.0.so.0 + 0x54acc)#12#3 0x00007fb92cb09876 _ZN20QEventDispatcherGlib13processEventsE6QFlagsIN10QEventLoop17ProcessEventsFlagEE (libQt5Core.so.5 + 0x309876)#12#4 0x00007fb92cab01bb _ZN10Q
2025-01-13T08:06:48.091107-05:00 lnx03 systemd[1]: [email protected]: Deactivated successfully.
2025-01-13T08:06:48.144989-05:00 lnx03 systemd[1]: [email protected]: Consumed 5.566s CPU time.

ulimit -a
real-time non-blocking time (microseconds, -R) unlimited
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 124363
max locked memory (kbytes, -l) 3991112
max memory size (kbytes, -m) unlimited
open files (-n) 15000
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 124363
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited

@donharter donharter added the Bug Either a bug report, or a bug fix. Let's hope for the latter! label Jan 13, 2025
@donharter
Copy link
Author

the generated dump file is too large

@donharter
Copy link
Author

I built " ./output/bin/qgis --version
QGIS 3.41.0-Master 'Master' (48f9d5f)" and it did not crash.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Either a bug report, or a bug fix. Let's hope for the latter! Crash/Data Corruption
Projects
None yet
Development

No branches or pull requests

2 participants