Custom activation functions for Deep Learning Toolbox?

Is it possible to use custom activation functions with the deep learning toolbox?

Answer 1

[Sebastian Castro]

Sure you can! Here is an example:

https://www.mathworks.com/help/deeplearning/ug/define-custom-deep-learning-layer.html

- Sebastian

[Andy]

does matlab support GELU — Gaussian Error Linear Unites ? (as described under: https://arxiv.org/pdf/1606.08415.pdf)