In this paper, impulse noise removal for digital images is handled. It is well-known that switching-type processing is effective for the impulse noise removal. In the process, noise-corrupted pixels are first detected, and then, filtering is applied to the detected pixels. This switching process prevents distorting original signals. A noise detector is of course important in the process, a filter for pixel value restoration is also important to obtain excellent results. The authors have proposed a local similarity-based filter (LSF). It utilizes local similarity in a digital image and its capability against restoration of orderly regions has shown in the previous paper. In this paper, first, further experiments are carried out and properties of the LSF are revealed. Although LSF is inferior to an existing filter when disorderly regions are processed and evaluated by the peak signal-to-noise ratio, its outputs are subjectively adequate even in the case. If noise positions are correctly detected, capability of the LSF is guaranteed. On the other hand, some errors may occur in actual noise detection. In that case, LSF sometimes fails to restoration. After properties are examined, we propose two effective extensions to the LSF. First one is for computational cost reduction and another is for color image processing. The original LSF is very time consuming, and in this paper, computational cost reduction is realized introducing a search area. Second proposal is the vector LSF (VLSF) for color images. Although color images can be processed using a filter, which is for monochrome images, to each color component, it sometimes causes color drift. Hence vector processing has been investigated so far. However, existing vector filters do not excel in preservation of orderly pattern although color drift is suppressed. Our proposed VLSF is superior both in orderly pattern preservation and color drift suppression. Effectiveness of the proposed extensions to LSF is verified through experiments.