If you just have a single problem to solve, then fine, go ahead and use a neural network. But if you want to do science and understand how to choose architectures, or how to go to a new problem, you have to understand what different architectures can and cannot do. – Marvin Minsky
There was a failure to recognize the deep problems in AI for instance, those captured in Blocks World. The people building physical robots learned nothing. – Marvin Minsky