This project is called SafeAR (also known as QuestWalk), an app deployed on the stand-alone Meta Quest 3 to easily create on-boarding, safety training and instructed procedures that can be used on-site in Augmented Reality. Similar projects include The Ghent Alterpiece by AlfaVision.
It is the result of work done between 18 February 2025 and 21 March 2025 (not including time spent writing the bid application) for the 5G Ecosystem - Proof of Concept call.
We could not have attempted this project in such a short time frame without starting from the incredible open source work of Immersive-Home and Solar-XR.
This is an example of guiding someone to refill the coffee machine in the DoESLiverpool hackspace.
Home Assistant is a huge modular home automation system that runs on an RaspberryPI. Immersive-Home is able to log into it to access its location-based sensors and controls and overlay them into Augmented Reality.
The Godot engine is a free, lightweight open source Game Engine that supports Virtual Reality features such as pass-through cameras and hand-tracking.
The Meta Quest 3 Virtual Reality headset runs Android which means that many the of the internal features of this operating system potentially available to an application running on it. Partway through the project the Godot-ExoPlayer feature appeared, which made it suddenly very easy to download and playback videos.
Node-RED is an optional component of Home Assistant that provides a visual flow-based coding system. It turns out to be pretty useful for planning and drawing flow charts for walk-throughs to be deployed to the Augmented Reality app. The ability to make and plan content is in some ways more important than the software to show it.
SafeAR/QuestWalk is looking for real world uses and applications that could pay for and drive its future development. You could theoretically download it and try it out yourself, but given the necessary sketchiness of the prototype product made on this time scale, you will need our help. Please contact Dynamic Devices for details.
You’ll need Android SDK Iguana (API 34) or later — the latest is fine.
Download: https://developer.android.com/studio/
Go and get sdkmanager working and run this command:
(replace <android_sdk_path> with your SDK install path)
sdkmanager --sdk_root=<android_sdk_path> \
"platform-tools" \
"build-tools;34.0.0" \
"platforms;android-34" \
"cmdline-tools;latest" \
"cmake;3.10.2.4988404" \
"ndk;23.2.8568313"
This installs:
- Android SDK Platform-Tools 34.0.0+
- Build-Tools 34.0.0
- Platform 34
- Command-line Tools (latest)
- CMake 3.10.2.4988404
- NDK r23c (23.2.8568313)
git clone https://github.com/DynamicDevices/Immersive-Home/
cd Immersive-Home/app/
Install required plugins using gd-plug (replace godot4 path with your Godot editor executable):
godot4 --headless -s plug.gd update debug
Plugins will install to /addons/:
godot-cdt
godot-xr-tools
godot_exoplayer
mqtt
promise
rdot
xr-autohandtracker
xr-simulator
Install from the Godot AssetLib or manually from:
https://github.com/GodotVR/godot_openxr_vendors
This is required for Android hardware integration.
In Editor Settings, set:
- Android SDK path
- Java SDK path
In Project Settings look for OpenXR and: - enable passthrough
- enable handtracking
- Ensure you’re logged into the owner account on the Quest.
- Enable developer mode in Quest settings.
- Connect the Quest to your computer via USB-C.
- If Meta Link asks to connect, click Disable (don’t check “do not ask me again” — that can auto-enable it later).
- Restart the Quest.
The Quest should prompt you about USB debugging after the restart and this allows remote deployment via Godot.
Build the Android export templates in your Godot project (do this before deploying).
In the template’s Meta settings, set Passthrough = Optional.