Long Term Dependencies in Sequence Learning

Sir Kepler, a renowned astronomer with famous three laws under his authorship took long time to device his principles. A Neural Network(NN) would have predicted Tycho Brahe’s trajectories without requiring Kepler’s flash of insight to try fitting the data to an ellipse. Sir Isaac Newton, however, would have had a much harder time deriving his laws of gravitation from a generic model. But what gives NNs, so much of…