MATLAB Answers

Gradient clipping with custom feed-forward net

2 views (last 30 days)
Everytime I am training my custom feed-forward net with 2 inputs and one output( timeseries) with the train(net,....) function:
after ~10 training epochs the value of the gradient reaches the prestet value and the training stops.
Changing the networks architecture is not an option in my case.
Is there a way to implement "gradient clipping" with a feed-forward net?
Or is there any other workaround for the "exploding gradient"?

Accepted Answer

Vineet Joshi
Vineet Joshi on 1 Sep 2021
Hi
The following documentation link will provide you suitable details regarding dealing with exploding gradients in MATLAB.
Hope this helps.
Thanks

More Answers (0)

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!