Markov Chains: Analytic and Monte Carlo Computations