Skip to content

docs: add Fedora 43 to FLM NPU Linux setup guide#2642

Open
bong-water-water-bong wants to merge 5 commits into
lemonade-sdk:mainfrom
bong-water-water-bong:docs/fedora-43-flm-setup
Open

docs: add Fedora 43 to FLM NPU Linux setup guide#2642
bong-water-water-bong wants to merge 5 commits into
lemonade-sdk:mainfrom
bong-water-water-bong:docs/fedora-43-flm-setup

Conversation

@bong-water-water-bong

Copy link
Copy Markdown
Contributor

Adds Fedora 43 as a distro option in the FLM NPU Linux setup docs.

Changes:

  • New 'Fedora 43' option in distro selector dropdown
  • Fedora 43 NPU setup instructions (COPR repo, XRT + amdxdna-dkms, validation)
  • Uses portable FLM (no RPM package, no beta flag required)

Refs: fedora-43-docs branch

- Adds Fedora 43 as a distro option in the FLM NPU Linux setup docs
- Uses portable FLM (no RPM package, no beta flag required)
- Removes misleading RPM install step that doesn't exist yet
@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.

@github-actions github-actions Bot added documentation Improvements or additions to documentation engine::flm FastFlowLM backend (NPU); multi-modal LLM/ASR/embeddings/reranking labels Jul 10, 2026
@superm1 superm1 requested a review from abn July 10, 2026 16:21
@superm1

superm1 commented Jul 10, 2026

Copy link
Copy Markdown
Member

Good by me, please let @abn sign off on this though.

Comment thread docs/flm_npu_linux.html
Comment thread docs/flm_npu_linux.html Outdated
<span class="flm-instruction-label">For Fedora 43</span>
</div>
<ol>
<li>Enable the AMD NPU COPR repository:

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
<li>Enable the AMD NPU COPR repository:
<li>Enable the AMD NPU Copr repository:

Comment thread docs/flm_npu_linux.html Outdated
<ol>
<li>Enable the AMD NPU COPR repository:
<div class="flm-code-block"><code>sudo dnf copr enable abn/amd-npu</code></div>
<span class="flm-inline-note">This COPR provides pre-built XRT and NPU driver packages. See <a href="https://copr.fedorainfracloud.org/coprs/abn/amd-npu/" target="_blank" rel="noopener">abn/amd-npu</a> for details.</span>

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
<span class="flm-inline-note">This COPR provides pre-built XRT and NPU driver packages. See <a href="https://copr.fedorainfracloud.org/coprs/abn/amd-npu/" target="_blank" rel="noopener">abn/amd-npu</a> for details.</span>
<span class="flm-inline-note">This Copr repository provides pre-built XRT and NPU user-space driver packages. See <a href="https://copr.fedorainfracloud.org/coprs/abn/amd-npu/" target="_blank" rel="noopener">abn/amd-npu</a> for details.</span>

Comment thread docs/flm_npu_linux.html Outdated
<span class="flm-inline-note">This COPR provides pre-built XRT and NPU driver packages. See <a href="https://copr.fedorainfracloud.org/coprs/abn/amd-npu/" target="_blank" rel="noopener">abn/amd-npu</a> for details.</span>
</li>
<li>Install the NPU runtime and driver:
<div class="flm-code-block"><code>sudo dnf install xrt amdxdna-dkms</code></div>

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
<div class="flm-code-block"><code>sudo dnf install xrt amdxdna-dkms</code></div>
<div class="flm-code-block"><code>sudo dnf install fastflowlm xrt-plugin-amdxdna</code></div>

Note this repo does not provide the amdxdna-dkms. Note this is already available on Fedora kernels and hence not required.

Comment thread docs/flm_npu_linux.html Outdated
Comment on lines +269 to +271
<li>Reboot:
<div class="flm-code-block"><code>sudo reboot</code></div>
</li>

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
<li>Reboot:
<div class="flm-code-block"><code>sudo reboot</code></div>
</li>

Comment thread docs/flm_npu_linux.html Outdated
</li>
<li>Verify the NPU stack:
<div class="flm-code-block"><code>flm validate</code></div>
A successful validation will show your kernel version, NPU device, firmware version, and unlimited memlock.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: you can add an example perhaps?

[Linux]  Kernel: 7.1.3-200.fc44.x86_64
[Linux]  NPU: /dev/accel/accel0 with 8 columns
[Linux]  NPU FW Version: 1.1.2.65
[Linux]  amdxdna version: 0.8
[Linux]  Memlock Limit: infinity

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well we won't have have flm in PATH with portable, I don't think we should have that.

- Fix COPR → Copr naming
- Clarify Copr provides xrt-plugin-amdxdna; amdxdna is in-kernel on F43
- Replace xrt amdxdna-dkms with fastflowlm xrt-plugin-amdxdna
- Add portable FLM auto-install note
- Remove reboot step (no DKMS needed)
- Replace flm validate (not in PATH with portable) with /dev/accel check
- Add example NPU detection output

Fixes: COPR capitalization, install target, verification approach
Refs: abn code review, superm1 code review
@bong-water-water-bong

Copy link
Copy Markdown
Contributor Author

Thanks for the reviews @abn and @superm1! I've pushed updates addressing the feedback:

Changes applied:

  • Fixed COPR → Copr capitalization throughout
  • Clarified that the Copr provides xrt-plugin-amdxdna only — the amdxdna kernel driver is already in Fedora 43's kernel (no DKMS needed)
  • Changed install from xrt amdxdna-dkmsfastflowlm xrt-plugin-amdxdna
  • Added the portable FLM auto-install note (matching Ubuntu 26.04's pattern)
  • Removed the reboot step
  • Replaced flm validate (not available in PATH with portable FLM) with a /dev/accel/accel0 + firmware version check, with an example output per your suggestion
  • Added a note that Lemonade auto-installs portable FLM if not available

Re: the broader question — whether Fedora 43 needs its own section vs the portable FLM handling it. I've kept it as a lightweight section similar to Ubuntu 26.04's pattern: the Copr is still needed for xrt-plugin-amdxdna (not bundled in the portable FLM), but the rest is simplified. Happy to trim further if you think the Copr + one-liner fits better inline in a shared note rather than a dedicated section.

Let me know if anything else needs adjustment!

@superm1

superm1 commented Jul 11, 2026

Copy link
Copy Markdown
Member

I don't believe you need a copr to install anything for flm. Everything except kernel driver is in portable.

@bong-water-water-bong

Copy link
Copy Markdown
Contributor Author

Addressed superm1's feedback — removed the COPR enable and dnf install steps since everything (FLM runtime + NPU plugin) is handled by the portable distribution on Fedora 43. The amdxdna kernel driver is already in Fedora 43's kernel. The section now just has the NPU verification step.

Comment thread docs/flm_npu_linux.html Outdated
<div class="flm-instruction-header">
<span class="flm-instruction-label">For Fedora 43</span>
</div>
<p>Fedora 43 ships with the <code>amdxdna</code> kernel driver in-tree — no extra driver or COPR repository needed.</p>

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Another nit; just use Fedora. This applies to all supported versions atm. And the latest is 44 anyway.

Comment thread docs/flm_npu_linux.html Outdated
<ol>
<li>Verify the NPU stack is detected:
<div class="flm-code-block"><code>ls /dev/accel/accel0 && cat /sys/kernel/debug/amd-xdna/pci*/version</code></div>
<span class="flm-inline-note">A successful NPU detection shows the device node and firmware version, for example:<br>

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This requires a manual run of the flm cli. But that requires lemonade to first download it, user to find and use the path.

I'd suggest as @superm1 mentioned, maybe just not include anything here.

Comment thread docs/flm_npu_linux.html Outdated
<p>Lemonade will auto-install the portable FLM binary (including the NPU plugin) on first use.</p>
<ol>
<li>Verify the NPU stack is detected:
<div class="flm-code-block"><code>ls /dev/accel/accel0 && cat /sys/kernel/debug/amd-xdna/pci*/version</code></div>

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
<div class="flm-code-block"><code>ls /dev/accel/accel0 && cat /sys/kernel/debug/amd-xdna/pci*/version</code></div>
<div class="flm-code-block"><code>ls -l /dev/accel/accel0 && modinfo amdxdna</code></div>

Maybe this is a little cleaner?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given we have a new enough kernel in both fedora 43 and 44 I don't see why a user would do this.

- Changed label from 'Fedora 43' to 'Fedora (43+)' (covers all supported versions)
- Removed manual kernel debugfs verification step (not needed on modern Fedora kernels per @superm1)
- Simplified to note that Lemonade handles FLM setup automatically
@bong-water-water-bong

Copy link
Copy Markdown
Contributor Author

Addressed the feedback:

  • Renamed 'Fedora 43' → 'Fedora (43+)' since the in-tree driver covers all supported Fedora versions
  • Removed the manual kernel debugfs verification step — not needed on modern Fedora kernels where amdxdna is already in-tree
  • Simplified to just note that Lemonade auto-installs FLM, no manual driver steps required

Thanks for the reviews @superm1 @abn!

- Change label from 'Fedora 43' to 'Fedora' (applies to all supported versions)
- Remove version-specific language
- Keep message concise: driver in-tree, FLM auto-installed
@bong-water-water-bong

Copy link
Copy Markdown
Contributor Author

Thanks @abn and @superm1 for the reviews. I've pushed an update:

  • Changed label from "For Fedora 43" → "For Fedora" (applies to current and future releases)
  • Removed version-specific language
  • Kept it minimal: driver in-tree, FLM auto-installed by Lemonade on first use

The PR description has also been updated to remove the COPR mention. Ready for re-review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation engine::flm FastFlowLM backend (NPU); multi-modal LLM/ASR/embeddings/reranking

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants