A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study

Setareh Zafari; Fabian Steiner; Marita Huber; Khaled Kassem Mahmoud Kassem; Patrik Zips; Manfred Tscheligi

doi:10.1145/3687272.3688304

A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study

Setareh Zafari, Fabian Steiner, Marita Huber, Khaled Kassem Mahmoud Kassem, Patrik Zips, Manfred Tscheligi

Publikation: Beitrag in Buch oder Tagungsband › Vortrag mit Beitrag in Tagungsband › Begutachtung

Abstract

Leveraging gesture-based controls within a remote interface for automated material handling operations presents a promising avenue to optimize efficiency, experience and safety in out-door environments. We present a gesture-based interactive system designed to facilitate collaboration between human operator and a semiautonomous forklift in material handling processes. Our interface supports commands that include starting the forklift, defining the amount of pallets that need to be loaded and transporting from a selected loading area to an unloading area.We tested and compared the proposed solution to a touch-based User interface in a field study to explore its effectiveness and identify potential challenges for implementation and adoption in industrial real-world settings.

Originalsprache	Englisch
Titel	HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction
Herausgeber (Verlag)	Association for Computing Machinery (ACM)
Seiten	176-184
ISBN (elektronisch)	9798400711787
DOIs	https://doi.org/10.1145/3687272.3688304
Publikationsstatus	Veröffentlicht - 24 Nov. 2024
Veranstaltung	12th International Conference on Human-Agent Interaction (HAI 2024) - Swansea University, Swansea, Großbritannien/Vereinigtes Königreich Dauer: 24 Nov. 2024 → 27 Nov. 2024 https://hai-conference.net/hai2024/

Konferenz

Konferenz	12th International Conference on Human-Agent Interaction (HAI 2024)
Kurztitel	HAI 2024
Land/Gebiet	Großbritannien/Vereinigtes Königreich
Stadt	Swansea
Zeitraum	24/11/24 → 27/11/24
Internetadresse	https://hai-conference.net/hai2024/

Research Field

Former Research Field - Human-centered Automation and Assistance

Zugriff auf Dokument

10.1145/3687272.3688304

Diese Publikation zitieren

Zafari, S., Steiner, F., Huber, M., Kassem, K. K. M., Zips, P., & Tscheligi, M. (2024). A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study. in HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction (S. 176-184). Association for Computing Machinery (ACM). https://doi.org/10.1145/3687272.3688304

@inproceedings{9ae13b705db941349d117df861081b59,

title = "A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study",

abstract = "Leveraging gesture-based controls within a remote interface for automated material handling operations presents a promising avenue to optimize efficiency, experience and safety in out-door environments. We present a gesture-based interactive system designed to facilitate collaboration between human operator and a semiautonomous forklift in material handling processes. Our interface supports commands that include starting the forklift, defining the amount of pallets that need to be loaded and transporting from a selected loading area to an unloading area.We tested and compared the proposed solution to a touch-based User interface in a field study to explore its effectiveness and identify potential challenges for implementation and adoption in industrial real-world settings.",

keywords = "Gesture-based interaction, Multi-modal interface, Human centered Automation, Automated Forklift, Material handling vehicle",

author = "Setareh Zafari and Fabian Steiner and Marita Huber and Kassem, {Khaled Kassem Mahmoud} and Patrik Zips and Manfred Tscheligi",

year = "2024",

month = nov,

day = "24",

doi = "10.1145/3687272.3688304",

language = "English",

pages = "176--184",

booktitle = "HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction",

publisher = "Association for Computing Machinery (ACM)",

address = "United States",

note = "12th International Conference on Human-Agent Interaction (HAI 2024), HAI 2024 ; Conference date: 24-11-2024 Through 27-11-2024",

url = "https://hai-conference.net/hai2024/",

}

Zafari, S, Steiner, F, Huber, M, Kassem, KKM, Zips, P & Tscheligi, M 2024, A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study. in HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction. Association for Computing Machinery (ACM), S. 176-184, 12th International Conference on Human-Agent Interaction (HAI 2024), Swansea, Großbritannien/Vereinigtes Königreich, 24/11/24. https://doi.org/10.1145/3687272.3688304

A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study. / Zafari, Setareh; Steiner, Fabian; Huber, Marita et al.
HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction. Association for Computing Machinery (ACM), 2024. S. 176-184.

Publikation: Beitrag in Buch oder Tagungsband › Vortrag mit Beitrag in Tagungsband › Begutachtung

TY - GEN

T1 - A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study

AU - Zafari, Setareh

AU - Steiner, Fabian

AU - Huber, Marita

AU - Kassem, Khaled Kassem Mahmoud

AU - Zips, Patrik

AU - Tscheligi, Manfred

PY - 2024/11/24

Y1 - 2024/11/24

N2 - Leveraging gesture-based controls within a remote interface for automated material handling operations presents a promising avenue to optimize efficiency, experience and safety in out-door environments. We present a gesture-based interactive system designed to facilitate collaboration between human operator and a semiautonomous forklift in material handling processes. Our interface supports commands that include starting the forklift, defining the amount of pallets that need to be loaded and transporting from a selected loading area to an unloading area.We tested and compared the proposed solution to a touch-based User interface in a field study to explore its effectiveness and identify potential challenges for implementation and adoption in industrial real-world settings.

AB - Leveraging gesture-based controls within a remote interface for automated material handling operations presents a promising avenue to optimize efficiency, experience and safety in out-door environments. We present a gesture-based interactive system designed to facilitate collaboration between human operator and a semiautonomous forklift in material handling processes. Our interface supports commands that include starting the forklift, defining the amount of pallets that need to be loaded and transporting from a selected loading area to an unloading area.We tested and compared the proposed solution to a touch-based User interface in a field study to explore its effectiveness and identify potential challenges for implementation and adoption in industrial real-world settings.

KW - Gesture-based interaction

KW - Multi-modal interface

KW - Human centered Automation

KW - Automated Forklift

KW - Material handling vehicle

U2 - 10.1145/3687272.3688304

DO - 10.1145/3687272.3688304

M3 - Conference Proceedings with Oral Presentation

SP - 176

EP - 184

BT - HAI '24: Proceedings of the 12th International Conference on Human-Agent Interaction

PB - Association for Computing Machinery (ACM)

T2 - 12th International Conference on Human-Agent Interaction (HAI 2024)

Y2 - 24 November 2024 through 27 November 2024

ER -

A Gesture-based Interactive System for Automated Material Handling Vehicles: Implementation and Comparative Study

Abstract

Konferenz

Research Field

Zugriff auf Dokument

Fingerprint

Diese Publikation zitieren