My personal thoughts regarding AI — Part 1

This is kind of personal but here I am going to share some experiences that I got from training different kinds of Neural Networks (NNs). Also I will not be very technical in this post, but just a kind of overview that might give you some insights or get to you some ideas regarding deep fundamental research. This is kind of personal, so many might disagree with me.

So first of all I am a AI Researcher working at the fundamentals of Deep Neural Networks (DNNs). While training DNNs for my research on various domain data, I many a times faced many situations that many a times questions about how we understand a DNN or in general NN. I am not saying that what we know is wrong or has some flaws, but if we try to look into the training fundamentals through the various epochs and the general training behavior then many a times we might see strange things that are many a times not properly understandable and we define those instances with terms like “overfitting” or “underfitting”. We have created the NNs so we can argue that we know the fundamentals of it’s operations, and in fact I also agree with it, but in reality how these NNs actually work from within are still unknown to us. There have been many literature that have mentioned about the black-box nature of these NNs. I have felt that NNs although excellent, is a bit of mystery.

Since I am into adversarial robustness, so from many experimentation results or from the experiments that I do, I have encountered many instances when I hardly have any answer to why the NNs are soo much vulnerable to these tiny imperceptible perturbations. I also don’t find enough convincing resource that truly explain why the vulnerability arises from the fundamentals of NNs. If you study deep into the effects of adversarial noise in NNs, then you also could come to a point where it will either put your current understanding of how NNs work in question or will offer a different interpretation to it.

So, this is all for today. Here I will write more about my experiences that I gather while I do my research. Thanks for coming to this end. If you have anything to say feel free to comment and I will be happy to talk.