RNN (Recurrent Neural nets) are used to model sequences. Unlike the usual feedforward nets which are stateless in terms on inputs, RNNs have memory. In particular, its inputs are the output of previous step and also new observation in current step. The basic RNN are notoriously hard to train. LSTM (Long short term memory) networks … Continue reading Recurrent Neural Net: Memo →