Error using gpuArray/subsasgn An unexpected error occurred during CUDA execution. The CUDA error was: CUDA_ERROR_LAUNCH_FAILED

My Matlab code is running on a workstation and it is on GPU. Whenever I sign out the workstation after a while this error occure:

"Error using gpuArray/subsasgn

An unexpected error occurred during CUDA execution. The CUDA error

was:

CUDA_ERROR_LAUNCH_FAILED"

What is the poroblem and how can it be fixed?

Answer 1

[Joss Knight]

What version of MATLAB are you using, what GPU and what platform?

This sounds like a problem seen before with workstation 'Sleep' or 'Suspend' power modes. Some period after you sign out your workstation enables this mode and GPU compute stops functioning in running applications. Typically this can be avoided by disabling Sleep mode, closing MATLAB before signing out, or ensuring that you are driving your display with a different GPU than you are using for compute.

Some versions of this issue have fixes, depending on your card and OS. You can also try updating your GPU driver.

[Ahmed Zaafouri]

Joss Knight, Please I have Matlab R2018a and I have this error: I cannot surpass this error in the training process

Error using trainNetwork (line 154)

Unexpected error calling cuDNN: CUDNN_STATUS_BAD_PARAM.

Error in fcnAlexNet_US (line 214)

[net, info] = trainNetwork(trainingData,lgraph,options);

Caused by:

Error using nnet.internal.cnngpu.convolveForward2D

Unexpected error calling cuDNN: CUDNN_STATUS_BAD_PARAM.

[Joss Knight]

Hi Ahmed. This seems like a new question. Why not search for this on Answers and if you don't find help, ask a new question.

[Ahmed Zaafouri]

Thank you Joss Knight for your response.

I tried to test solutions and answers proposed in the mathwork community but the taining network error persists.

For example I test the response that you proposed like in this link

https://fr.mathworks.com/matlabcentral/answers/778632-unexpected-error-calling-cudnn-cudnn_status_bad_param

But the problem persists

[Joss Knight]

Please ask a new question so that everyone can see it and either answer it or benefit from the answer.