Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Phi-2 Model Load Error #2

Closed
fydeos-alex opened this issue Mar 26, 2024 · 2 comments
Closed

Phi-2 Model Load Error #2

fydeos-alex opened this issue Mar 26, 2024 · 2 comments

Comments

@fydeos-alex
Copy link

I got the 'PhiConfig' object has no attribute 'n_embd', what should I do?

I am trying to load it from huggingface and convert the trained model into an RKLLM format model, but the error occurred. I think it might caused by the update, can anyone tell me the version of phi-2 without this update?

THx🙏

@lzz773751548 lzz773751548 closed this as not planned Won't fix, can't repro, duplicate, stale Mar 26, 2024
@lzz773751548 lzz773751548 reopened this Mar 26, 2024
@lzz773751548
Copy link
Collaborator

Yes, you're correct. The issue you're encountering is likely due to a recent update in the phi-2 model configuration that removed or altered the n_embd attribute. To resolve this, I recommend using the phi-2 model version associated with the specific commit mentioned below. This version does not include the recent changes that are causing the error you're experiencing.
https://hf-mirror.com/microsoft/phi-2/tree/834565c23f9b28b96ccbeabe614dd906b6db551a

@fydeos-alex
Copy link
Author

I truly appreciate your help. Thank you so much.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants