We first review the analytic approximations proposed to approximate the posterior of ARMA models. We use the Kullback-Leibler divergence to study the relation between these analytic approximations.