Getting Buffer Validation newBufferWith must not exceed 256 MB error when I am trying to load model of 2.5 gb size #5384
Labels
platform:ios
MediaPipe IOS issues
stat:awaiting googler
Waiting for Google Engineer's Response
task:LLM inference
Issues related to MediaPipe LLM Inference Gen AI setup
type:others
issues not falling in bug, perfromance, support, build and install or feature
I have downloaded Google iOS sample of MediaPipe and tried to load my model which is 2.5 GB in size.
The project is built successfully but on App launch, I am getting following error:
I came to know that a single MTLBuffer is limited to a maximum length of 256MB. If we need a total allocation of more than 256 MB, we can allocate multiple buffers and split data among them, but I don't know how I will be able to do in case of this SDK.
The text was updated successfully, but these errors were encountered: