chore(vulkan): enable arm64 image builds

[mudler]

Description

This PR fixes #5778

Notes for Reviewers

This is first an attempt to see if CI builds against vulkan on arm64

See docker/build-push-action#671 regarding using arm64 native runners for multiplatform builds.
Signed commits

• Yes, I signed my commits.

[netlify]

✅ Deploy Preview for localai ready!

Name	Link
🔨 Latest commit	2aed98d
🔍 Latest deploy log	https://app.netlify.com/projects/localai/deploys/68d97f46212c2d000854c887
😎 Deploy Preview	https://deploy-preview-5780--localai.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify project configuration.

[docjyJ]

Hey

Unfortunately vulkan-sdk is not precompiled for arm64. It must be compiled manually...

There also are not plans to update our Ubuntu packages for ARM. Again users can use the tarball for this situation.
See https://vulkan.lunarg.com/issue/view/654594145df11238996e13fe

[mudler]

Hey

Unfortunately vulkan-sdk is not precompiled for arm64. It must be compiled manually...

There also are not plans to update our Ubuntu packages for ARM. Again users can use the tarball for this situation.
See https://vulkan.lunarg.com/issue/view/654594145df11238996e13fe

appreciated, thanks for the heads up, will give it a shot later in the day, but I see already the CI is emitting core dumps, seen that already in ubuntu images. Might need use of our self-hosted runners for this or try to rebase and work out #5553 first.

[docjyJ]

It's great to see that it's marked on the roadmap. I'm really looking forward to running LocalAI on my RK3588. If you need any help, don't hesitate to ask.

[szaimen]

@mudler any update here? What is missing to merge this?

[mudler]

@mudler any update here? What is missing to merge this?

I didn't had time into looking at this again, but what's missing is actually consuming and installing the vulkan-sdk during the build process. The problem is that, if we compile it along the process it will take too much time out and the CI will eventually fail - we need to find a pre-compiled version. I was having a look at https://github.com/mudler/vulkan-sdk-arm but paused since then

[docjyJ]

I don't understand why they don't offer a compiled version for ARM.

[mudler]

I don't understand why they don't offer a compiled version for ARM.

Neither do I :( it would make things much more simpler...

In any case, will take a stab at it again as soon as 3.8 is out. There are many feature in the pipeline for 3.8 that kept me busy!