In-Situ Digital Content Creation And Retrieval Toward New Mobile Usage
COM1 Level 3
MR1, COM1-03-19
Abstract :
Mobile computing has dramatically transformed how people handle and manipulate digital content. Previously, digital content creation and retrieval were limited to sedentary activities in a room, relying on keystrokes and button clicks. However, the advances in mobile technology have driven a notable shift towards in-situ digital content creation and retrieval. In line with this transformative shift, this thesis introduces two new in-situ mobile scenarios: 1) in-situ experiential multimedia article generation and 2) situational information retrieval during a procedural task. By employing a human-centered and iterative design process, this thesis develops the multimodal mobile interaction and workflow for each scenario, enabling seamless performance. Additionally, by implementing the scenarios as working prototypes, this thesis validates their feasibility. Furthermore, this thesis establishes a unified framework for in-situ digital content creation and retrieval by conceptualizing the developed scenarios as two human-natural activities, namely, the “Look-And-Tell” and “Show-And-Ask” activities. Building upon this framework, this thesis proposes extending the traditional boundaries of mobile input and output, leveraging mobile devices as all-in-one tools for seamless data transfer between the real and digital realms. Besides, this thesis discusses the potential of reshaping conventional mobile applications with extended mobile input and output capabilities and explores future research opportunities for in-situ digital content creation and retrieval on wearable devices, such as smart glasses. Through these endeavors, this thesis demonstrates how people’s mobile usage can evolve beyond the mere utilization of specific application functions.