onnxruntime-gpu服务部署后，显卡逐渐增大，当请求完成或者停止后，显存不下降 #403
yiluzhuimeng
started this conversation in
General
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
onnxruntime-gpu 1.19.2
cuda 12.4
torch 2.4.1
onnxruntime-gpu服务部署后，显卡逐渐增大，当请求完成或者停止后，显存不下降
Beta Was this translation helpful? Give feedback.
All reactions