In this paper, a fundamental study is carried out to clarify the compression softening characteristics of fiber reinforced cementitious composite focusing on the fiber volume fraction and the size effect parameters. Based on the compression tests, the compression softening parameters of both post-peak displacement and post-peak strain are evaluated, and a simple linear softening model is applied to finite element analysis in order to predict the experimental results. The analytical predictions indicate that the simple linear softening model is applicable and both the fiber volume fraction and the size effect parameters should be considered to achieve the further reliability.