A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study

Setareh Zafari; Fabian Steiner; Marita Huber; Khaled Kassem Mahmoud Kassem; Patrik Zips; Manfred Tscheligi

doi:10.1145/3687272.3688304

A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study

Setareh Zafari, Fabian Steiner, Marita Huber, Khaled Kassem Mahmoud Kassem, Patrik Zips, Manfred Tscheligi

Research output: Chapter in Book or Conference Proceedings › Conference Proceedings with Oral Presentation › peer-review

Abstract

Leveraging gesture-based controls within a remote interface for automated material handling operations presents a promising avenue to optimize efficiency, experience and safety in out-door environments. We present a gesture-based interactive system designed to facilitate collaboration between human operator and a semiautonomous forklift in material handling processes. Our interface supports commands that include starting the forklift, defining the amount of pallets that need to be loaded and transporting from a selected loading area to an unloading area.We tested and compared the proposed solution to a touch-based User interface in a field study to explore its effectiveness and identify potential challenges for implementation and adoption in industrial real-world settings.

Original language	English
Title of host publication	HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction
Publisher	Association for Computing Machinery (ACM)
Pages	176-184
ISBN (Electronic)	9798400711787
DOIs	https://doi.org/10.1145/3687272.3688304
Publication status	Published - 24 Nov 2024
Event	12th International Conference on Human-Agent Interaction (HAI 2024) - Swansea University, Swansea, United Kingdom Duration: 24 Nov 2024 → 27 Nov 2024 https://hai-conference.net/hai2024/

Conference

Conference	12th International Conference on Human-Agent Interaction (HAI 2024)
Abbreviated title	HAI 2024
Country/Territory	United Kingdom
City	Swansea
Period	24/11/24 → 27/11/24
Internet address	https://hai-conference.net/hai2024/

Research Field

Former Research Field - Human-centered Automation and Assistance

Keywords

Gesture-based interaction
Multi-modal interface
Human centered Automation
Automated Forklift
Material handling vehicle

Access to Document

10.1145/3687272.3688304

Cite this

Zafari, S., Steiner, F., Huber, M., Kassem, K. K. M., Zips, P., & Tscheligi, M. (2024). A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study. In HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction (pp. 176-184). Association for Computing Machinery (ACM). https://doi.org/10.1145/3687272.3688304

@inproceedings{9ae13b705db941349d117df861081b59,

title = "A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study",

abstract = "Leveraging gesture-based controls within a remote interface for automated material handling operations presents a promising avenue to optimize efficiency, experience and safety in out-door environments. We present a gesture-based interactive system designed to facilitate collaboration between human operator and a semiautonomous forklift in material handling processes. Our interface supports commands that include starting the forklift, defining the amount of pallets that need to be loaded and transporting from a selected loading area to an unloading area.We tested and compared the proposed solution to a touch-based User interface in a field study to explore its effectiveness and identify potential challenges for implementation and adoption in industrial real-world settings.",

keywords = "Gesture-based interaction, Multi-modal interface, Human centered Automation, Automated Forklift, Material handling vehicle",

author = "Setareh Zafari and Fabian Steiner and Marita Huber and Kassem, {Khaled Kassem Mahmoud} and Patrik Zips and Manfred Tscheligi",

year = "2024",

month = nov,

day = "24",

doi = "10.1145/3687272.3688304",

language = "English",

pages = "176--184",

booktitle = "HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction",

publisher = "Association for Computing Machinery (ACM)",

address = "United States",

note = "12th International Conference on Human-Agent Interaction (HAI 2024), HAI 2024 ; Conference date: 24-11-2024 Through 27-11-2024",

url = "https://hai-conference.net/hai2024/",

}

Zafari, S, Steiner, F, Huber, M, Kassem, KKM, Zips, P & Tscheligi, M 2024, A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study. in HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction. Association for Computing Machinery (ACM), pp. 176-184, 12th International Conference on Human-Agent Interaction (HAI 2024), Swansea, United Kingdom, 24/11/24. https://doi.org/10.1145/3687272.3688304

A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study. / Zafari, Setareh; Steiner, Fabian; Huber, Marita et al.
HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction. Association for Computing Machinery (ACM), 2024. p. 176-184.

Research output: Chapter in Book or Conference Proceedings › Conference Proceedings with Oral Presentation › peer-review

TY - GEN

T1 - A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study

AU - Zafari, Setareh

AU - Steiner, Fabian

AU - Huber, Marita

AU - Kassem, Khaled Kassem Mahmoud

AU - Zips, Patrik

AU - Tscheligi, Manfred

PY - 2024/11/24

Y1 - 2024/11/24

N2 - Leveraging gesture-based controls within a remote interface for automated material handling operations presents a promising avenue to optimize efficiency, experience and safety in out-door environments. We present a gesture-based interactive system designed to facilitate collaboration between human operator and a semiautonomous forklift in material handling processes. Our interface supports commands that include starting the forklift, defining the amount of pallets that need to be loaded and transporting from a selected loading area to an unloading area.We tested and compared the proposed solution to a touch-based User interface in a field study to explore its effectiveness and identify potential challenges for implementation and adoption in industrial real-world settings.

AB - Leveraging gesture-based controls within a remote interface for automated material handling operations presents a promising avenue to optimize efficiency, experience and safety in out-door environments. We present a gesture-based interactive system designed to facilitate collaboration between human operator and a semiautonomous forklift in material handling processes. Our interface supports commands that include starting the forklift, defining the amount of pallets that need to be loaded and transporting from a selected loading area to an unloading area.We tested and compared the proposed solution to a touch-based User interface in a field study to explore its effectiveness and identify potential challenges for implementation and adoption in industrial real-world settings.

KW - Gesture-based interaction

KW - Multi-modal interface

KW - Human centered Automation

KW - Automated Forklift

KW - Material handling vehicle

U2 - 10.1145/3687272.3688304

DO - 10.1145/3687272.3688304

M3 - Conference Proceedings with Oral Presentation

SP - 176

EP - 184

BT - HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction

PB - Association for Computing Machinery (ACM)

T2 - 12th International Conference on Human-Agent Interaction (HAI 2024)

Y2 - 24 November 2024 through 27 November 2024

ER -

A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study

Abstract

Conference

Research Field

Keywords

Access to Document

Fingerprint

Cite this