Skip to content

Normalize NVIDIA library paths to /usr/lib/#425

Open
maherthomsi wants to merge 3 commits into
bottlerocket-os:developfrom
maherthomsi:nvidia-normalization
Open

Normalize NVIDIA library paths to /usr/lib/#425
maherthomsi wants to merge 3 commits into
bottlerocket-os:developfrom
maherthomsi:nvidia-normalization

Conversation

@maherthomsi

@maherthomsi maherthomsi commented May 5, 2026

Copy link
Copy Markdown
Contributor

Merge with bottlerocket-os/bottlerocket-core-kit#919
Description of changes:

Normalize NVIDIA library installation paths from /usr/lib/nvidia/tesla/ to the standard /usr/lib/ path. Create backwards-compatibility symlinks in /usr/lib/nvidia/tesla/ pointing back to /usr/lib/ for workloads thatreference the legacy path.

Changes across kmod-6.1-nvidia-r580, kmod-6.12-nvidia-r580, and kmod-6.18-nvidia-r580:

  • Move library installation from nvidia/tesla/ subdirectory to /usr/lib/ directly
  • Add %{_cross_libdir}/nvidia/tesla/* to %files for the backwards-compat symlinks
  • Remove nvidia-ld.so.conf.in (Source302) and all references — no longer needed since libraries are in the standard linker search path
  • Remove nvidia/tesla tmpfiles directory entry

Testing done:

  • Built kernel-kit for both x86_64 and aarch64
  • Published to ECR and built aws-k8s-1.35-nvidia variant AMIs
  • Launched g4dn.xlarge (Tesla T4) node on EKS cluster
  • Verified nvidia-smi works (driver 580.126.09)
  • Verified on host: libraries at /usr/lib/, symlinks at /usr/lib/nvidia/tesla/../../<lib>
  • Verified in container: libraries mounted at /usr/lib/, symlinks at /usr/lib/nvidia/tesla//usr/lib/<lib>
  • Ran nvidia smoke tests - all passed

Terms of contribution:

By submitting this pull request, I agree that this contribution is dual-licensed under the terms of both the Apache License, version 2.0, and the MIT license.

@maherthomsi maherthomsi changed the title Normalize library paths to /usr/lib/ Normalize NVIDIA library paths to /usr/lib/ May 5, 2026
@mgsharm

mgsharm commented May 5, 2026

Copy link
Copy Markdown
Contributor

Can we have separate commits for each kmod. Also the commit is not signed and doesn't have Signed-off-by.

@maherthomsi

Copy link
Copy Markdown
Contributor Author

Split up commits for each kmod. Signed commits and added Signed off by to commits

@maherthomsi maherthomsi force-pushed the nvidia-normalization branch from 66fe31d to a06d78e Compare May 11, 2026 17:57
@maherthomsi

Copy link
Copy Markdown
Contributor Author

Force push to fix merge conflicts

Comment thread packages/kmod-6.1-nvidia-r580/kmod-6.1-nvidia-r580.spec
Comment thread packages/kmod-6.1-nvidia-r580/kmod-6.1-nvidia-r580.spec Outdated
Comment thread packages/kmod-6.1-nvidia-r580/kmod-6.1-nvidia-r580.spec
Comment thread packages/kmod-6.12-nvidia-r580/kmod-6.12-nvidia-r580.spec Outdated
@maherthomsi maherthomsi force-pushed the nvidia-normalization branch from a06d78e to 5a61475 Compare May 21, 2026 20:23
@maherthomsi

Copy link
Copy Markdown
Contributor Author

Force push: Addresses above comments to move symlink creation into the existing for-loop across all three spec files (6.1, 6.12, 6.18)

@maherthomsi maherthomsi force-pushed the nvidia-normalization branch 2 times, most recently from 2784d02 to 30f9ed6 Compare June 8, 2026 21:38
@maherthomsi maherthomsi force-pushed the nvidia-normalization branch 2 times, most recently from d320749 to 2a5a068 Compare June 9, 2026 23:03
Comment thread packages/kmod-6.1-nvidia-r580/kmod-6.1-nvidia-r580.spec Outdated
Move nvidia libraries from /usr/lib/nvidia/tesla/ to the standard
/usr/lib/ path. Create backwards-compatibility symlinks in
/usr/lib/nvidia/tesla/ pointing back to /usr/lib/.

Remove nvidia-ld.so.conf.in (Source302) and its references since
libraries are now in the standard linker search path. Remove the
tmpfiles entry for the nvidia/tesla directory.

Signed-off-by: Maher Homsi <maherhom@amazon.com>
Move nvidia libraries from /usr/lib/nvidia/tesla/ to the standard
/usr/lib/ path. Create backwards-compatibility symlinks in
/usr/lib/nvidia/tesla/ pointing back to /usr/lib/.

Remove nvidia-ld.so.conf.in (Source302) and its references since
libraries are now in the standard linker search path. Remove the
tmpfiles entry for the nvidia/tesla directory.

Signed-off-by: Maher Homsi <maherhom@amazon.com>
Move nvidia libraries from /usr/lib/nvidia/tesla/ to the standard
/usr/lib/ path. Create backwards-compatibility symlinks in
/usr/lib/nvidia/tesla/ pointing back to /usr/lib/.

Remove nvidia-ld.so.conf.in (Source302) and its references since
libraries are now in the standard linker search path. Remove the
tmpfiles entry for the nvidia/tesla directory.

Signed-off-by: Maher Homsi <maherhom@amazon.com>
@maherthomsi maherthomsi force-pushed the nvidia-normalization branch from 2a5a068 to c7d017d Compare June 16, 2026 19:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants