MATLAB Answers

ANN SCG train function

8 views (last 30 days)
nur dsc
nur dsc on 11 Mar 2021
Commented: nur dsc on 6 Apr 2021
Hi,
I have some questions about Matlab ANN algorithm functions.
1) I have an example about ANN which is used trainscg as the train function .What does train function means ? Because we know that we can add so many layers and every layer has own activation function. I think trainscg function is just used help to minimize error in loss function (like cross-entropy) , right ? So it is not activation function.I think it is just an optimizer . But why matlab called it train function ?
I want to replicate this function in Python but I have no idea which function I should use instead of trainscg. How about ADAM or SGD ?
2) Is there any difference between tangent sigmoid activation function and sigmoid function activation function?
Thanks.

Answers (1)

Vineet Joshi
Vineet Joshi on 26 Mar 2021
Hi
Network training functions are functions in MATLAB used to train a neural network using a specified algorithm.
trainscg for example uses scaled conjugate gradient backpropagation as a training algorithm where as traingdx uses gradient descent with momentum and adaptive learning rate backpropagation as a training algorithm.
Apart from a train function, a network in MATLAB uses other function properties like adaptation function or performance function.
The details of which can be found here.
As for your other question, they key difference between both is activation function is for tansig (Tangent Sigmoid) the range is between [-1 and 1] whereas for logsig (Sigmoid) the range is [0,1] although both make an S-shaped curve.
Hope this helps.
  1 Comment
nur dsc
nur dsc on 6 Apr 2021
Hello, thanks for tansig function explanation but my question was like that : I think trainscg function is just used help to minimize error in loss function (like cross-entropy) , right ? So it is not activation function.I think it is just an optimizer . But why matlab called it train function ?
And in python what is trainscg ? I want to replicate this function in Python but I have no idea which function I should use instead of trainscg. How about ADAM or SGD ?

Sign in to comment.

Tags

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!