You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
RuntimeError(
"Unsloth: Tokenizer's pad_token cannot be = eos_token, and we couldn't find a\n"
"replacement of either <|reserved... or <|placeholder..."
)
The text was updated successfully, but these errors were encountered:
Oh that is an issue - the pad_token must be not the same as the eos_token, otherwise the finetune will be incorrect. I'll see if I can extend the tokenizer itself
训练qwen1.5-14b-chat,遇到下面的报错,transformers==4.38.2
RuntimeError(
"Unsloth: Tokenizer's pad_token cannot be = eos_token, and we couldn't find a\n"
"replacement of either <|reserved... or <|placeholder..."
)
The text was updated successfully, but these errors were encountered: