ESP32-S3 tensorflow-micropython flashing

[avadhana25]

Port, board and/or hardware

esp32s3

MicroPython version

Micropython v1.20 , ESP32-S3-WROOM-1

Reproduction

Forked a branch of a branch of https://github.com/mocleiri/tensorflow-micropython-examples, https://github.com/TheImagineThat/tensorflow-micropython-examples. His most recent workflow on the build_esp32s3.yml worked 5 months ago but does not anymore.

Expected behaviour

I expected the artifact to be created for myself in my branch just as it did for his branch. The new error that occurs is that the build cannot install wheel during the esp-idf set up process. I believe this is because the micropython/tools/ci.sh script utilizes esp-idf v4.4, which I have observed conisistently has this issue.

Observed behaviour

Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'error'
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [319 lines of output]
Compiling src/gevent/resolver/cares.pyx because it changed.
[1/1] Cythonizing src/gevent/resolver/cares.pyx
performance hint: src/gevent/libev/corecext.pyx:1291:5: Exception check on '_syserr_cb' will always require the GIL to be acquired.
Possible solutions:
1. Declare '_syserr_cb' as 'noexcept' if you control the definition and you're sure you don't want the function to raise exceptions.
2. Use an 'int' return type on '_syserr_cb' to allow an error code to be returned.
warning: src/gevent/libev/corecext.pyx:1288:0: Global name __SYSERR_CALLBACK matched from within class scope in contradiction to to Python 'class private name' rules. This may change in a future release.
warning: src/gevent/libev/corecext.pyx:1288:0: Global name __SYSERR_CALLBACK matched from within class scope in contradiction to to Python 'class private name' rules. This may change in a future release.
warning: src/gevent/libev/corecext.pyx:1288:0: Global name __SYSERR_CALLBACK matched from within class scope in contradiction to to Python 'class private name' rules. This may change in a future release.
warning: src/gevent/libev/corecext.pyx:1288:0: Global name __SYSERR_CALLBACK matched from within class scope in contradiction to to Python 'class private name' rules. This may change in a future release.

  Error compiling Cython file:
  ------------------------------------------------------------
  ...
          if events & ~(libev.EV__IOFDSET | libev.EV_READ | libev.EV_WRITE):
              raise ValueError('illegal event mask: %r' % events)
          # All the vfd_functions are no-ops on POSIX
          cdef int vfd = libev.vfd_open(fd)
          libev.ev_io_init(&self._watcher, <void *>gevent_callback_io, vfd, events)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1027:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
              raise ValueError('illegal event mask: %r' % events)
          # All the vfd_functions are no-ops on POSIX
          cdef int vfd = libev.vfd_open(fd)
          libev.ev_io_init(&self._watcher, <void *>gevent_callback_io, vfd, events)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &io_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1028:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
  
      def __cinit__(self, loop loop, double after=0.0, double repeat=0.0, ref=True, priority=None):
          if repeat < 0.0:
              raise ValueError("repeat must be positive or zero: %r" % repeat)
          libev.ev_timer_init(&self._watcher, <void *>gevent_callback_timer, after, repeat)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1072:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
      def __cinit__(self, loop loop, double after=0.0, double repeat=0.0, ref=True, priority=None):
          if repeat < 0.0:
              raise ValueError("repeat must be positive or zero: %r" % repeat)
          libev.ev_timer_init(&self._watcher, <void *>gevent_callback_timer, after, repeat)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &timer_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1073:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
          # 1) "libev: ev_signal_start called with illegal signal number"
          #    EV_NSIG might be different from signal.NSIG on some platforms
          # 2) "libev: a signal must not be attached to two different loops"
          #    we probably could check that in LIBEV_EMBED mode, but not in general
          libev.ev_signal_init(&self._watcher, <void *>gevent_callback_signal, signalnum)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1117:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
          #    EV_NSIG might be different from signal.NSIG on some platforms
          # 2) "libev: a signal must not be attached to two different loops"
          #    we probably could check that in LIBEV_EMBED mode, but not in general
          libev.ev_signal_init(&self._watcher, <void *>gevent_callback_signal, signalnum)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &signal_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1118:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
  
      cdef libev.ev_idle _watcher
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_idle_init(&self._watcher, <void*>gevent_callback_idle)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1133:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
      cdef libev.ev_idle _watcher
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_idle_init(&self._watcher, <void*>gevent_callback_idle)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &idle_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1134:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
  
      cdef libev.ev_prepare _watcher
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_prepare_init(&self._watcher, <void*>gevent_callback_prepare)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1146:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
      cdef libev.ev_prepare _watcher
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_prepare_init(&self._watcher, <void*>gevent_callback_prepare)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &prepare_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1147:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
  
      cdef libev.ev_check _watcher
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_check_init(&self._watcher, <void*>gevent_callback_check)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1159:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
      cdef libev.ev_check _watcher
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_check_init(&self._watcher, <void*>gevent_callback_check)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &check_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1160:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
  
      cdef libev.ev_fork _watcher
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_fork_init(&self._watcher, <void*>gevent_callback_fork)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1172:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
      cdef libev.ev_fork _watcher
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_fork_init(&self._watcher, <void*>gevent_callback_fork)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &fork_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1173:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
          # Note the use of ev_async_pending instead of ev_is_pending
          return True if libev.ev_async_pending(&self._watcher) else False
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_async_init(&self._watcher, <void*>gevent_callback_async)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1189:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
          return True if libev.ev_async_pending(&self._watcher) else False
  
      def __cinit__(self, loop loop, ref=True, priority=None):
          libev.ev_async_init(&self._watcher, <void*>gevent_callback_async)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &async_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1190:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
              raise AttributeError("Child watchers are not supported on Windows")
          if not loop.default:
              raise TypeError('child watchers are only available on the default loop')
          libev.gevent_install_sigchld_handler()
          libev.ev_child_init(&self._watcher, <void *>gevent_callback_child, pid, trace)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1212:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
          if not loop.default:
              raise TypeError('child watchers are only available on the default loop')
          libev.gevent_install_sigchld_handler()
          libev.ev_child_init(&self._watcher, <void *>gevent_callback_child, pid, trace)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &child_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1213:20: Cannot convert 'start_and_stop *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
              self._paths = paths
          else:
              paths = <bytes>path
              self._paths = paths
          libev.ev_stat_init(&self._watcher, <void *>gevent_callback_stat, <char*>paths, interval)
          self.__watcher = <libev.ev_watcher*>&self._watcher
                           ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1263:25: Cannot convert 'ev_watcher *' to Python object
  
  Error compiling Cython file:
  ------------------------------------------------------------
  ...
          else:
              paths = <bytes>path
              self._paths = paths
          libev.ev_stat_init(&self._watcher, <void *>gevent_callback_stat, <char*>paths, interval)
          self.__watcher = <libev.ev_watcher*>&self._watcher
          self.__ss = &stat_ss
                      ^
  ------------------------------------------------------------
  
  src/gevent/libev/corecext.pyx:1264:20: Cannot convert 'start_and_stop *' to Python object
  Compiling src/gevent/libev/corecext.pyx because it changed.
  [1/1] Cythonizing src/gevent/libev/corecext.pyx
  Traceback (most recent call last):
    File "/home/runner/.espressif/python_env/idf4.4_py3.12_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
      main()
    File "/home/runner/.espressif/python_env/idf4.4_py3.12_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
      json_out["return_val"] = hook(**hook_input["kwargs"])
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/runner/.espressif/python_env/idf4.4_py3.12_env/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
      return hook(config_settings)
             ^^^^^^^^^^^^^^^^^^^^^
    File "/tmp/pip-build-env-isiyh5m0/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 334, in get_requires_for_build_wheel
      return self._get_build_requires(config_settings, requirements=[])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/tmp/pip-build-env-isiyh5m0/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 304, in _get_build_requires
      self.run_setup()
    File "/tmp/pip-build-env-isiyh5m0/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 522, in run_setup
      super().run_setup(setup_script=setup_script)
    File "/tmp/pip-build-env-isiyh5m0/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 320, in run_setup
      exec(code, locals())
    File "<string>", line 49, in <module>
    File "/tmp/pip-install-z270l34g/gevent_cd6ec6713a014702897ca1c04cef07b6/_setuputils.py", line 254, in cythonize1
      new_ext = cythonize(
                ^^^^^^^^^^
    File "/tmp/pip-build-env-isiyh5m0/overlay/lib/python3.12/site-packages/Cython/Build/Dependencies.py", line 1154, in cythonize
      cythonize_one(*args)
    File "/tmp/pip-build-env-isiyh5m0/overlay/lib/python3.12/site-packages/Cython/Build/Dependencies.py", line 1321, in cythonize_one
      raise CompileError(None, pyx_file)
  Cython.Compiler.Errors.CompileError: src/gevent/libev/corecext.pyx
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
Creating a new Python environment in /home/runner/.espressif/python_env/idf4.4_py3.12_env
Installing virtualenv
Traceback (most recent call last):
File "/home/runner/work/tensorflow-micropython-examples/tensorflow-micropython-examples/esp-idf/tools/idf_tools.py", line 1828, in
Installing Python packages from /home/runner/work/tensorflow-micropython-examples/tensorflow-micropython-examples/esp-idf/requirements.txt
main(sys.argv[1:])
File "/home/runner/work/tensorflow-micropython-examples/tensorflow-micropython-examples/esp-idf/tools/idf_tools.py", line 1824, in main
action_func(args)
File "/home/runner/work/tensorflow-micropython-examples/tensorflow-micropython-examples/esp-idf/tools/idf_tools.py", line 1545, in action_install_python_env
subprocess.check_call(run_args, stdout=sys.stdout, stderr=sys.stderr, env=env_copy)
File "/usr/lib/python3.12/subprocess.py", line 413, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/runner/.espressif/python_env/idf4.4_py3.12_env/bin/python', '-m', 'pip', 'install', '--no-warn-script-location', '-r', '/home/runner/work/tensorflow-micropython-examples/tensorflow-micropython-examples/esp-idf/requirements.txt', '--extra-index-url', 'https://dl.espressif.com/pypi']' returned non-zero exit status 1.

Additional Information

I'm trying to find/build a firmware for my ESP32-S3-WROOM-1 with PSRAM,BLE,and TensorFlow Lite capabilities. I am using micropython, but having struggles trying to run a tensorflow model on my board. If anyone else has done this before and has any tips I would greatly appreciate it!

Code of Conduct

Yes, I agree