You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The hugging face repository does not seem to have the latest version and it seems it is not possible to know what llamafile version you are downloading.
Maybe something should be done about that?
Would you be willing to post this as a separate issue?
I run llamafile with the mistral model as:
./mistral-7b-instruct-v0.2.Q5_K_M.llamafile -ngl 9999 --port 8080 --host 0.0.0.0 --embedding --threads 16
I don't have a GPU.
If I run
llamafile "crashes" with the message:
The text was updated successfully, but these errors were encountered: