Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Force-Off ROCm and CUDA builds in gen_linux.sh even if they are present. #4511

Closed
dreirund opened this issue May 18, 2024 · 3 comments
Assignees
Labels
feature request New feature or request

Comments

@dreirund
Copy link

Ahoj,

there is a need to force a build without CUDA or ROCm, even if some of their libraries are present on the system.

But current gen_linux.sh forces ROCm build if some libraries are found, even if ROCm is not desired.

Arch Linux AUR package ollama-nogpu-git has a patch to patch out all CUDA and ROCm stuff in gen_linux.sh, but this upstream here seems to change things too fast that it is not feasible to stay up to date with that patch.

So I here wish for a feature to make it built-in that ROCm (and CUDA) build can be forced-off (e.g. by an environment variable or command line switch) even if their libraries or just some of them are present. (On my system, I have only some stuff in /opt/rocm/, which is needed by some package, but is not a full and not a functional ROCm installation. This currently breaks building ollama.)

Regards!

@dreirund dreirund added the feature request New feature or request label May 18, 2024
@dhiltgen dhiltgen self-assigned this May 21, 2024
@dhiltgen
Copy link
Collaborator

This was recently fixed via #4462 to use the same variables we have on the windows build.

@dreirund
Copy link
Author

dreirund commented Jun 7, 2024 via email

archlinux-github pushed a commit to archlinux/aur that referenced this issue Jun 7, 2024
@dhiltgen
Copy link
Collaborator

dhiltgen commented Jun 7, 2024

@dreirund good catch! We missed that on the recent addition of oneapi - I'll get a PR up to add that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants