data_process中，使用load_4bit加载liuhaotian/llava-v1.6-34b模型报错

[sunfan1997]

显存只有16G，想处理一批自己的数据，如何量化加载liuhaotian/llava-v1.6-34b模型，报错ValueError: Calling cuda() is not supported for 4-bit or 8-bit quantized models. Please use the model as it is, since the model has already been set to the correct devices and casted to the correct dtype.有什么办法减少显存占用吗，或者说最低需要多少显存才能跑data process部分。

[github-actions]

This issue is stale because it has been open for 7 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 7 days since being marked as stale.