This paper proposes a method to create a shear beam model consisting of elements that represent hysteretic characteristics of the dampers, their support members/connections, and frames in a passively controlled muluti-story and multi-bay building. Four types of dampers, steel, oil, viscous, and viscoelastic dampers, are considered. The model enables efficient and practical time history analyses of the building subjected to ground motions. Degrees of freedom of the building are reduced to a few per floor, by conducting two or three static analyses. Then, a shear beam model of a few degrees of freedom per floor level is constructed by matching its behavior exactly with the building. The accuracy of the shear beam model is demonstrated via static analyses as well as dynamic analyses using a variety of ground motions.