How to tune the regularization parameter in extreme learning machine?
3 views (last 30 days)
Show older comments
mohammed mahmoud
on 2 Oct 2018
Answered: BERGHOUT Tarek
on 4 Feb 2019
I train ELM on my dataset and gives test accuracy of 92.13. I wonder how to tune parameters to gain more test accuracy?
1 Comment
BERGHOUT Tarek
on 3 Feb 2019
if you want to get beter trainig accuracy in basic SLFN traind by ELM you should do this:
1- invrease the nuber of neurons one by one using incrimental ELM until the networks gives a stable accuracy
2- after that you can change the formula of beta "B=pinv(H)*T" to this one
(B=(inv((I/C)+H'*H)*H'*T);
wher I is the identity matrix you can type "help eye " in Matlab;
and try yo make your hidden layers as a squered matrix.
and after that you can increase your regularization parameter C incrimentaly until you get the minimam training error.
Accepted Answer
BERGHOUT Tarek
on 4 Feb 2019
if you want to get beter trainig accuracy in basic SLFN traind by ELM you should do this:
1- invrease the nuber of neurons one by one using incrimental ELM until the networks gives a stable accuracy
2- after that you can change the formula of beta "B=pinv(H)*T" to this one
(B=(inv((I/C)+H'*H)*H'*T);
wher I is the identity matrix you can type "help eye " in Matlab;
and try yo make your hidden layers as a squered matrix.
and after that you can increase your regularization parameter C incrimentaly until you get the minimam training error.
0 Comments
More Answers (0)
See Also
Categories
Find more on Genomics and Next Generation Sequencing in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!