Understanding the Role of Image Recognition in Mobile Tour Guides

Abstract

Users of mobile tour guides often express a strong desire for the system to be able to provide information on arbitrary objects they encounter during their visit - akin to pointing to a building or attraction and saying "what's that ?" to a human tour guide. This paper reports on a field study in which we investigated user reaction to the use of digital image capture and recognition to support such functionality. Our results provide an insight into usage patterns and likely user reaction to mobile tour guides that use digital photography for real-time object recognition. These results include the counter-intuitive observation that a significant class of users appear happy to use image recognition even when this is a more complex, lengthy and error-prone process than traditional solutions. Careful analysis of user behavior during the field trails also provides evidence that it may be possible to classify tourists according to the methods by which they prefer to acquire information about tourist attractions in their vicinity. If shown to be generally true these results have important implications for designers of future mobile tour guide systems.

Keywords: Mobile tour guides, mobile camera phones, object recognition,
user experience, user evaluation.

References

1. Aoki, P.M. and Woodruff, A.: Improving Electronic Guidebook Interfaces Using a Task-Oriented Design Approach. Proc 3rd ACM Conf. DIS, 2000, pp. 319-325.
2. Baus, J., Cheverst, K. and Kray, C.: A Survey of Mobile Guides. A Survey of Map-based Mobile Guides in: Mapbased mobile services - Theories, Methods and Implementations. Chapter 13. Springer-Verlag., Zipf, A., Meng, L. and Reichenbacher, T. (Eds). 2005.
3. Borntr?er, C., Cheverst, K., Davies, N., Dix, A., Friday, A. and Seitz, J.: Experiments with multi-modal interfaces in a context-aware city guide. Proc. Fifth Int. Symp. on Human Computer Interaction with Mobile Devices and Services, Udine (Italy), September 2003.
4. Cheverst, K., Davies, N., Mitchell, K., Friday, A. and Efstratiou, C.: Developing a Context-aware Electronic Tourist Guide: Some Issues and Experiences. Proc of CHI?00, Netherlands. 17-24 March 2000.
5. Davies, N., Cheverst, K., Mitchell, K. and Efrat, A.: Using and Determining Location in a Context-Sensitive Tour Guide: The GUIDE Experience. Special issue of IEEE Computer on Location-based Computing. August 2001.
6. Dix, A.: Beyond intention - pushing boundaries with incidental interaction. Proc. Building Bridges: Interdisciplinary Context-Sensitive Computing, Glasgow University, 9 Sept 2002
7. Fleck, M., Frid, M., Kindberg, T., O?Brien-Strain, E., Rajani, R. and Spasojevic, M.: From Informing to Remembering: Ubiquitous Systems in Interactive Museums. IEEE Pervasive Computing, Vol. 1, No. 2. 2002.
8. Kjeldskov J., Skov M. B., Als B. S. and H?gh R. T.: Is it Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field . Proc. 6th International Mobile HCI 2004 conference, Glasgow, Scotland. Lecture Notes in Computer Science, Berlin, Springer-Verlag, pp. 61-73
9. Long, S., Kooper, R., Abowd, G.D. and Atkeson, C.G.: Rapid Prototyping of Mobile Context-Aware Applications: The CyberGuide Case Study. Proc. of 2nd ACM International Conference on Mobile Computing (Mobicom). 1996.
10. Sarvas, R., Herrarte, E., Wilhelm, A. and Davis, M.: Metadata Creation System for Mobile Images. Proc of Second International Conference on Mobile Systems, Applications, and Services (MobiSys2004), Boston, Massachusetts. ACM Press, 2004.
11. Wilhelm, A., Takhteyev, Y., Sarvas, R., Van House, N. and Davis. M.: Photo Annotation on a Camera Phone. Extended Abstracts of CHI 2004. Vienna, Austria. ACM Press, 1403-1406, 2004.

FIGURE 2. Prototype in use

FIGURE 6. "What's this?"

http://www.hcibook.com/alan/papers/visceral-2005/

Alan Dix 26/6/2005