Markovian queueing systems are widely used in the modelling of telecommunication systems, manufacturing systems, inventory systems and many other practical systems. Very often, in the system performance analysis, one faces the problem of solving the system steady-state probability distribution of a large number of states. Fast numerical algorithms based on Preconditioned Conjugate Gradient (PCG) method are developed to solve the problem efficiently.