-
Notifications
You must be signed in to change notification settings - Fork 815
Issues: pytorch/serve
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Two-way authentication/Mutual SSL in gRPC
enhancement
New feature or request
#3172
opened Jun 3, 2024 by
MohamedAliRashad
The service crashes if the model takes a long time to respond
grpc
#3168
opened May 31, 2024 by
yurkoff-mv
NotImplementedError: Cannot copy out of meta tensor; no data!
+ Models not generating output text
#3167
opened May 31, 2024 by
bjorquera1
Make torchserve-kfs docker image multiplatform
enhancement
New feature or request
kfserving
#3161
opened May 25, 2024 by
DanielTemesgen
Support "model-control-mode" in configuration
enhancement
New feature or request
p0
high priority
security
Limit resource in docker compose and worker in model
triaged
Issue has been reviewed and triaged
#3150
opened May 21, 2024 by
ToanLyHoa
Continuous Batching does not work with newest transformer issue
#3148
opened May 21, 2024 by
udaij12
question to model inference optimization
triaged
Issue has been reviewed and triaged
#3134
opened May 4, 2024 by
geraldstanje
If micro_batch_size of micro-batch is set to 1, then model inference is still batch processing?
#3120
opened Apr 29, 2024 by
pengxin233
CUDA out of Memory with low Memory Utilization (CUDA error: device-side assert triggered)
#3114
opened Apr 25, 2024 by
emilwallner
TorchServe crashes in production with `WorkerThread - IllegalStateException error'
#3087
opened Apr 15, 2024 by
MaelitoP
Serve multiple models with both CPU and GPU
question
Further information is requested
triaged
Issue has been reviewed and triaged
#3078
opened Apr 10, 2024 by
hungtrieu07
TorchServe linux aarch64 plan
dependencies
Pull requests that update a dependency file
enhancement
New feature or request
#3072
opened Apr 3, 2024 by
agunapal
4 tasks
Previous Next
ProTip!
Find all open issues with in progress development work with linked:pr.