A new numerical technique is demonstrated and shown to reduce exponentially the time required for Monte Carlo simulations of non-equilibrium systems. The quasi stationary probability dis- tribution is computed for two model systems, and the results are compared with the asymptotically exact theory in the limit of extremely small noise intensity. Singularities of the non-equilibrium distributions are revealed by the simulations.