CapCap is an output-agreement game that challenges players' listening and speaking skills. Players submit their transcriptions for short video segments against a countdown timer, in one of three pre-specified modes, to score points and support their team. Adding entertainment value, the game channels input toward captioning videos without monetary rewards. It deploys a novel human computation algorithm, which collects input from a crowd of non-experts, sequentially and in parallel, until a completion criterion is met. Rather than monetary incentive, CapCap uses motivational mechanisms like indirect feedback, mix of player skills, and community identification. Preliminary results from a field trial with mostly non-native English speakers improved the WER of English captions over ASR output.
Cite as: Kacorri, H., Shinkawa, K., Saito, S. (2015) Capcap: an output-agreement game for video captioning. Proc. Interspeech 2015, 2814-2818, doi: 10.21437/Interspeech.2015-592
@inproceedings{kacorri15_interspeech,
author={Hernisa Kacorri and Kaoru Shinkawa and Shin Saito},
title={{Capcap: an output-agreement game for video captioning}},
year=2015,
booktitle={Proc. Interspeech 2015},
pages={2814--2818},
doi={10.21437/Interspeech.2015-592}
}