A Time Varying Hidden Markov Model with Latent Information