Having problems with the trainnet function

I am trying to fine tune a machine learning model. While using the trainnet function it states "Training stopped: Training loss is NaN" in the command window. The old trainNetwork functions works, which to me makes it weird that trainnet does not. How do I work around this? Possible solutions?

[Matt J]

Please post enough of your code for us to run and reproduce the problem. Please also post the code as formatted text, e.g.,

imageSize=[256,384];

rather than as an image, so that it can be easily copy/pasted.

Answer 1

[Jayanti]

Hi Andrew,

I tried to run the code you provided on custom dataset, and it is working fine as you can see in the attached image.

Without actual data, it is difficult to provide a definitive solution upfront. However, the following two options can be explored to address this issue:

1. Adjusting learning rate – If learning rate is very high it can cause the model to diverge, leading to “NaN” values. So, try reducing the learning rate.
2. Gradient Clipping - Consider adding gradient clipping to prevent exploding gradients.

Hope it helps!