The defect structure models of LiNbO3 (lithium niobate) were reviewed, with emphasis on the “Li-site vacancy model” we recently proposed on the basis of the results of single crystal X-ray and powder neutron diffraction experiments. A detailed scheme of Mg-incorporation in the LiNbO3 structure was also presented using our defect model.