TY - JOUR AU - Finch, Andrew AU - Song, Wei AU - Tanaka-Ishii, Kumiko AU - Sumita, Eiichiro PY - 2013/06/21 Y2 - 2024/03/28 TI - Speaking Louder than Words with Pictures Across Languages JF - AI Magazine JA - AIMag VL - 34 IS - 2 SE - Articles DO - 10.1609/aimag.v34i2.2471 UR - https://ojs.aaai.org/aimagazine/index.php/aimagazine/article/view/2471 SP - 31 AB - In this article, we investigate the possibility of cross-language communication using a synergy of words and pictures on mobile devices. Communicating with only pictures is in itself a very powerful strategy, but is limited in expressiveness. On the other hand, words can express everything you could wish to say, but they are cumbersome to work with on mobile devices, and need to be translated in order for their meaning to be understood. Automatic translations can contain errors that pervert the communication process, and this may undermine the users’ confidence when expressing themselves across language barriers. Our idea is to create a user interface for cross-language communication that uses pictures as the primary mode of input, and words to express the detailed meaning. This interface creates a visual process of communication that occurs on two heterogeneous channels that can support each other. We implemented this user interface as application on the Apple iPad tablet, and performed a set of experiments to determine its usefulness as a translation aid for travellers. ER -