> A neural net can capture all those smaller eigenvectors in the signal that are routinely thrown away during traditional feature engineering

What on earth are you talking about?

>Deep nets are here to stay.

Maybe in silicon valley for consumer products in things like snapchat and siri. They won't work for industrial problems.