![](https://www.mathworks.com/matlabcentral/answers/uploaded_files/1635091/image.png)
t-sne visualization of Vision transformer
5 views (last 30 days)
Show older comments
How to visualize the features of the vision transfomer after training using t-sne visualizion?
example of vision transformer: https://se.mathworks.com/help/deeplearning/ug/train-vision-transformer-network-for-image-classification.html
and t-sne visualization of CNN: https://se.mathworks.com/help/deeplearning/ug/view-network-behavior-using-tsne.html
I could not apply the same in vision transformer beacuse there are an error during using actication function as follows:
earlyLayerName = "'encoderblock1_mha1";
pool1Activations = activations(net,...
augimdsTrain,earlyLayerName,"OutputAs","rows");
0 Comments
Answers (1)
Garmit Pant
on 5 Mar 2024
From what I gather, you are following the MATLAB examples “Train Vision Transformer Network for Image Classification” and “View Network Behavior Using tsne” to visualise the results of the network activations of a trained vision transformer. You are encountering an error in the process.
The line of code where you are encountering the error is trying to refer to a non-existent layer, assuming you are using the MATLAB default implementation of the “visionTransformer” network. By analysing the network, we can see the layer is named “encoderblock1_mha” and not “encoderblock1_mha1”. Unless you have renamed and replaced the layer, passing the correct layer name shall eliminate the result.
![](https://www.mathworks.com/matlabcentral/answers/uploaded_files/1635091/image.png)
I hope you find the above explanation and suggestions useful!
5 Comments
adolf hitler
on 15 May 2024
Hi Garmit
Have you solved the problem? I had the same problem when I was executing code.
adolf hitler
on 15 May 2024
Hi Mahmoud
Have you solved the problem? I had the same problem when I was executing code.
See Also
Categories
Find more on Image Data Workflows in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!