For dynamic analysis of structures, selection of ground motion (GM) is a crucial problem. For design, a tough GM should be used. It is difficult, however, to find such GM, because different GM can be the toughest in terms of different aspect. Uncertainty of structural properties complicates the problem. In this paper, an approach is presented to select design GMs out of a set of possible GMs using feature indices which are related with expected damage mechanisms of the structure. Uncertainty of nonlinear response is also incorporated. Quality of the GM selected in this scheme depends on the index considered. This paper discusses the efficiency of various indices through numerical simulations. Results verify the performance of the presented method and clarify several conditions to be taken into consideration.