Caubel, Nemethi, and Popescu-Pampu in [2] proved that an oriented 3-manifold admits at most one positive contact structure which can be realized as the complex tangency along the link of a complex surface singularity. They call it the Milnor fillable contact structure. Lekili and Ozbagci in [10] showed that a Milnor fillable contact structure is universally tight. In particular, by Honda's classification [5], the link of a cusp singularity is contactomorphic to the positive contact structure associated to the Anosov flow on a Sol-manifold (see [1]). We describe the contact structure on the link of a cusp singularity in two different ways without using Honda's classification theorem. One description is based on the toric method introduced in Mori [15]. The other description is based on Hirzebruch's construction of the Hilbert modular cusps. Consequently, we give certain answers to the problems in Mori [14] concerning the relation between the cusp singularities and the simple elliptic singularities, and the higher dimensional extension of the local Lutz-Mori twist.