Missing modules.order and modules.builtin (broken dotmesh install)

[joeauty]

User requirement

My install is now broken, I want to fix it. Tried a reinstall, dm cluster reset, but dm cluster init generates the following in OS X Catalina:

depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.dep.tmp, 1101, 644): Read-only file system
depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.dep.bin.tmp, 1101, 644): Read-only file system
depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.alias.tmp, 1101, 644): Read-only file system
depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.alias.bin.tmp, 1101, 644): Read-only file system
depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.softdep.tmp, 1101, 644): Read-only file system
depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.symbols.tmp, 1101, 644): Read-only file system
depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.symbols.bin.tmp, 1101, 644): Read-only file system
depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.builtin.bin.tmp, 1101, 644): Read-only file system
depmod: ERROR: openat(/system-lib/lib/modules/4.19.76-linuxkit, modules.devname.tmp, 1101, 644): Read-only file system

• modprobe -d /system-lib zfs
  modprobe: FATAL: Module zfs not found in directory /system-lib/lib/modules/4.19.76-linuxkit
• fetch_zfs
  ++ uname -r
• KERN=4.19.76-linuxkit
• RELEASE=zfs-4.19.76-linuxkit.tar.gz
• cd /bundled-lib
• '[' -d /bundled-lib/lib/modules ']'
• curl -f -o zfs-4.19.76-linuxkit.tar.gz https://get.dotmesh.io/zfs/zfs-4.19.76-linuxkit.tar.gz
  % Total % Received % Xferd Average Speed Time Time Time Current
  Dload Upload Total Spent Left Speed
  100 19.7M 100 19.7M 0 0 2341k 0 0:00:08 0:00:08 --:--:-- 4035k
• tar xf zfs-4.19.76-linuxkit.tar.gz
• depmod -b /bundled-lib
  depmod: WARNING: could not open /bundled-lib/lib/modules/4.19.76-linuxkit/modules.order: No such file or directory
  depmod: WARNING: could not open /bundled-lib/lib/modules/4.19.76-linuxkit/modules.builtin: No such file or directory
• modprobe -d /bundled-lib zfs
  modprobe: ERROR: ../libkmod/libkmod.c:514 lookup_builtin_file() could not open builtin file '/bundled-lib/lib/modules/4.19.76-linuxkit/modules.builtin.bin'
  modprobe: ERROR: ../libkmod/libkmod.c:514 lookup_builtin_file() could not open builtin file '/bundled-lib/lib/modules/4.19.76-linuxkit/modules.builtin.bin'
  modprobe: ERROR: could not insert 'zfs': Exec format error

[lukemarsden]

Thanks for the bug report! We were just talking about fixing this today.

BTW, did you decide to try dotmesh because you saw my talk at the Bristol Data Science meetup? :) If so, check out dotscience.com, where you can spin up dotmesh in a Jupyter container on our SaaS for free.

[joeauty]

Thanks for the bug report! We were just talking about fixing this today.

BTW, did you decide to try dotmesh because you saw my talk at the Bristol Data Science meetup? :) If so, check out dotscience.com, where you can spin up dotmesh in a Jupyter container on our SaaS for free.

I did not see your talk, is it online?

Thanks for looking into this! We're all very interested in Dotmesh and would love to be informed and educated about all plans and development roadmap stuff :)

[lukemarsden]

Thanks @joeauty, what's your use case for Dotmesh out of interest?

[joeauty]

Thanks @joeauty, what's your use case for Dotmesh out of interest?

Dataset collaboration among our dev team for QA. I remember one of your talks at a Dockercon got into ML cases, we aren't there yet, but we see value in "Git for data", and I used to use ZFS in a past life so I understand its merits for use cases like this!

[prisamuel]

This issue is related to dotmesh-io/zfs-builder#6 -> support for zfs-4.19.76-linuxkit