Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error message when training MPT-7B #7

Open
jianchaoji opened this issue Jun 1, 2023 · 2 comments
Open

Error message when training MPT-7B #7

jianchaoji opened this issue Jun 1, 2023 · 2 comments

Comments

@jianchaoji
Copy link

Hi I got a message when I try to use Lora to train MPT-B, do you have any ideas to solve it?

ValueError: Unable to create tensor, you should probably activate truncation and/or padding with 'padding=True' 'truncation=True' to have batched tensors with the same length. Perhaps your features (instruction in this case) have excessive nesting (inputs type list where type int is expected).

@benam2
Copy link

benam2 commented Jun 20, 2023

Hi @jianchaoji Were able to fine tune MPT model?

@jianchaoji
Copy link
Author

I'm afraid not.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants