This article will be available on 12/July/2010 Roman, D, Mitra, G and Spagnolo N. Hidden Markov models for financial optimization problems. IMA Journal of Management Mathematics. In press., Oxford University Press (2009). URL: http://imaman.oxfordjournals.org/cgi/content/abstract/dpp009