Effective remote automated vehicle operation: a mixed reality contextual comparison study

With the increasing pervasion of automated vehicle fleets, there is an equally increased need to provide effective remote operation capabilities for interventions in cases of vehicle malfunction, rough road conditions or unnavigable areas. This shift in the human operator role to that of an observer and occasional teleoperator requires appropriate interaction interfaces. In this paper, we present an in-context analysis of previously proposed teleoperation information requirements realized as concrete user interfaces in a user study (N=16). Participants completed multiple tasks in a mixed approach, controlling an actual miniature vehicle via an XR enabled headset which showed two interface manifestations (minimum and maximum requirements realized). From the results, we derive separate sets of fundamental UI elements per requirement for effective teleoperation in two phases of interaction: orientation and navigation. We conclude with further suggestions to extend teleoperation UIs regarding contexts and tasks beyond the navigation use case used in the study.