Does setting BiasLearnRateFactor=0 prevent bias updates in a fullyConnectedLayer?
4 views (last 30 days)
Show older comments
actorNet = [
featureInputLayer(prod(obsInfo.Dimension))
fullyConnectedLayer(64, Bias=zeros(64,1), BiasLearnRateFactor=0)
reluLayer
fullyConnectedLayer(64, Bias=zeros(64,1), BiasLearnRateFactor=0)
fullyConnectedLayer(prod(actInfo.Dimension))
scalingLayer(Scale=5000, Bias=0)
];
actorOptions = rlOptimizerOptions( ...
LearnRate=1e-4, ...
GradientThreshold=1, ...
L2RegularizationFactor=1e-4);
I constructed an actor network and set the optimizer options as shown above.
My question is:
If I set BiasLearnRateFactor=0 in the fullyConnectedLayer, does this mean that the bias will not be updated at all during training?
0 Comments
Answers (1)
See Also
Categories
Find more on Matrix Computations in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!