A vision system for the Unmanned Surface Vessel is introduced in this paper. It consists of two stereo vision cameras, two Leddar sensors and a Pan-Tilt Unit. With this vision system a big view range can be obtained and the target objects such as obstacles can be detected. Through experiments, it is verified that this system can work well. This vision system can be used to other robot platform.