Description: This paper shows how actuarial pricing based on the mathematical concept of present value can be formulated and solved using Markov chains and an approach borrowed from engineering mathematics called ballistic control theory.