Improving usability playtesting for experimental games - An analysis of how fidelity and the playtest process impact player feedback

Abstract

This thesis explores the playtesting process, with a specific focus on usability testing for games with experimental mechanics. The aim was to derive practical advice for developers to use when eliciting feedback, which was successfully achieved. Two different aspects of the playtest were directly investigated in this research project. The first was whether or not the playtester should state their thoughts out loud while playing. This was conducted by having two groups of testers play through the same demo, with one group playing silently and the other being more active. The findings show that having the tester give feedback while playing, as well as having the facilitator ask questions throughout, elicits far more usability feedback without having a noticeable effect on the player experience. The second aspect under investigation was the impact of prototype fidelity on the feedback elicited. For this, three versions of the same experimental game prototype were made; a fully polished version, a low fidelity digital version, and a paper prototype. By comparing the feedback elicited from each prototype, the effectiveness of each technique for playtesting could be investigated. From our findings, a paper prototype is sufficient for testing the initial concept but not ideal for usability or experience testing. Meanwhile, a low fidelity version is ideal for eliciting usability feedback but unreliable with regards to understanding the player experience.