Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

convert-hf-to-gguf.py fails PR #7234 #7380

Open
LostRuins opened this issue May 19, 2024 · 0 comments · May be fixed by #7472
Open

convert-hf-to-gguf.py fails PR #7234 #7380

LostRuins opened this issue May 19, 2024 · 0 comments · May be fixed by #7472

Comments

@LostRuins
Copy link
Collaborator

Hi, after merging #7234 , model conversion with convert-hf-to-gguf.py is broken.

  File "E:\LLaMA\llamacpp\gguf-py\gguf\lazy.py", line 9, in <module>
    from numpy._typing import _Shape
ModuleNotFoundError: No module named 'numpy._typing'

I was using numpy-1.22.3 After force upgrading my environment to the latest numpy-1.26.4, the script finally works.

However, I am hoping that it is possible to allow it to work with numpy 1.22 as it did before this commit as a fallback? A lot of toolchains might still be on slightly older versions of numpy, forcing the use of the latest newest version may not be ideal.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant