A probabilistic construction of the heat semigroup and kernel associated with certain non-commutative harmonic oscillators is given. As an application, the unitarily equivalence of the non-commutative harmonic oscillators with the ordinary harmonic oscillators is shown.