I have come to realize that this is a more open-set recognition problem. I am still researching on this topic. Currently, I am trying to classify images as in-distribution, out-of-distribution and abnormal. The accuracy with which I can do varies upon the images used in training. So, I have much work ahead.
If anyone is working on these topics, I would like to have few discussions and sharing of ideas.
:) Thanks for your time.