An evaluation of cognitive modeling tools

Abstract

This thesis evaluates several aspects of the cognitive modeling tools, using a questionnaireas the survey method. We try to assess the the suitability for cognitivemodeling task of the cognitive modeling tools, from the perspective of internationalcommunity of cognitive modeling tool users. Part of this assessment is done withrespect to general usability of software and the rest is specialized for the cognitivemodeling issues. Frequency and correlation analyses reveal that there is a significant1relationship between suitability as a software product and suitability as a cognitivemodeling tool. Specifically, there are correlations between the features of the toolinvolving flexibility, presentation of input and output and the process of design, implementationand evaluation of a cognitive modeling tool, while these processes arenegatively related to adversely effecting features of the tool, such as having to doextra tasks that are not related to the actual task. Our study confirms that a cognitivemodeling tool can also be evaluated from the perspective of a general purposesoftware product, and also gives clues about directions for improvement to tool developers.Keywords: cognitive architectures, cognitive modeling, software evaluation, cognitivemodeling tools2