Publications

With our publications we cover the most diverse research areas that arise in the field of man, task and technology. In addition to traditional Business Information Systems topics such as knowledge management and business process management, you will also find articles on current topics such as blended learning, cloud computing or smart grids. Use this overview to get an impression of the range and possibilities of research in Business Information Systems at the University of Duisburg-Essen.

Type of Publication: Article in Journal

Artificial Intelligence for Sign Language Translation – A Design Science Research Study

Author(s):
Strobel, Gero; Schoormann, Thorsten; Banh, Leonardo; Möller, Frederik
Title of Journal:
Communications of the Association for Information Systems
Volume (Publication Date):
53 (2023)
Number of Issue:
3
Digital Object Identifier (DOI):
doi:10.17705/1CAIS.05303
Link to complete version:
https://aisel.aisnet.org/cais/vol53/iss1/22/
Citation:
Download BibTeX

Abstract

Although our digitalized society is able to foster social inclusion and integration, there are still numerous communities having unequal opportunities. This is also the case with deaf people. About 750,000 deaf people only in the European Union and over 4 million people in the United States face daily challenges in terms of communication and participation, such as in leisure activities but more importantly in emergencies too. To provide equal environments and allow people with hearing handicaps to communicate in their native language, this paper presents an AI-based sign language translator. We adopted a transformer neural network capable of analyzing over 500 data points from a person’s gestures and face to translate sign language into text. We have designed a machine learning pipeline that enables the translator to evolve, build new datasets, and train sign language recognition models. As proof of concept, we instantiated a sign language interpreter for an emergency call with over 200 phrases. The overall goal is to support people with hearing inabilities by enabling them to participate in economic, social, political, and cultural life.