Carl Westin

7-1 Retrospective 155 found slightly more consistent than trainees, at least in regards to the control prob- lem classification (i.e., one aircraft controlled ahead or behind the other). The effect of experience was, however, not directly evaluated (e.g., by using novice and expe- rienced controllers in the same experiment), leaving this open for future research. 7-1-3 Foundations for conformance: Consistency and agreement The concept of strategic conformance hinged on two assumptions: that controllers solved conflicts consistently, but disagreed on which solution to use. Establishing consistency is important as, otherwise, it cannot be argued that a system is confor- mal. Establishing a lack of consensus is important as, otherwise, there is no bene- fit of personalizing a system. Data from the three empirical studies were used to, post hoc, investigate these assumptions, starting with an investigation of controllers’ problem-solving strategies. Figure 7-1 provides an overview of the four studies in this thesis and their rela- tionship in relation to the Consistency study. Findings and questions from the First empirical study (controllers with varying experience) were addressed in three addi- tional studies (illustrated by the grey arrows). In two separate real-time simulations, the Source bias (experienced controllers) and Automation transparency (trainees) studies explored strategic conformance and other variables (advisory source and in- terface transparency, respectively). The Consistency study, however, consisted of a First empirical study Source bias study Automation transparency study Consistency study Real-time simulations Real-time simulations, experienced Real-time simulations, trainees Prequel simulation Prequel simulation Prequel simulation Conformance design Conformance design Conformance design Experiment simulation Experiment simulation Experiment simulation Post hoc analysis of prequel data in above studies Study 1: Prequel data from the First empirical study (biased conflict) Study 2: Prequel data from Source bias and Automation transparency study (unbiased conflict) F IGURE 7-1: Overview of empirical studies and their relationship.