Part of the book series:Lecture Notes in Computer Science ((LNISA,volume 4022))
Included in the following conference series:
440Accesses
Abstract
This paper describes our results from the image retrieval task of iCLEF 2005 based on a comparative user evaluation of two interfaces: one displaying search results as a list; the other organising retrieved images into a hierarchy of concepts displayed on the interface as an interactive menu. Based on a known-item retrieval task, data was analysed with respect to effectiveness, efficiency and user satisfaction. Effectiveness and efficiency were calculated at both the set cut-off time of 5 minutes, and the time after finding the target image (final time). Results showed the list was marginally more effective than the menu at 5 minutes, but the two were equal at final time indicating the menu requires more time to be used effectively. The list was more efficient at both 5 minutes and final time (difference not statistically significant) and users preferred using the menu indicating this could be a potentially interesting and engaging feature for image retrieval.
This is a preview of subscription content,log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hearst, M.: User Interfaces and Visualization. In: Baeza-Yates, R., Ribeiro-Neto, B. (eds.) Modern Information Retrieval, pp. 257–323. ACM Press, New York (1999)
Sanderson, M., Croft, B.: Deriving concept hierarchies from text. In: Proceedings of the 22nd ACM Conference of the Special Interest Group in Information Retrieval, pp. 206–213 (1999)
Joho, H., Sanderson, M., Beaulieu, M.: A Study of User Interaction with a Concept-based Interactive Query Expansion Support Tool. In: McDonald, S., Tait, J. (eds.) Advances in Information Retrieval, 26th European Conference on Information Retrieval, pp. 42–56 (2004)
Savoy, J., Berger, P.-Y.: Selection and Merging Strategies for Multilingual Information Retrieval. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 27–37. Springer, Heidelberg (2005)
Robertson, S.E., Walker, S., Beaulieu, M.M., Gatford, M., Payne, A.: Okapi at TREC-4. In: Harman, D.K. (ed.) NIST Special Publication 500-236: The Fourth Text REtrieval Conference (TREC-4), Gaithersburg, MD, pp. 73–97 (1995)
Petrelli, D., Beaulieu, M., Sanderson, M., Demetriou, G., Herring, P.: Observing Us-ers Designing Clarity: A Case Study on the User-Centered Design of a Cross-Language In-formation Retrieval System. JASIST Journal of the American Society for Information Sci-ence and Technology 55(10), 923–934 (2004)
Petrelli, D., Levin, S., Beaulieu, M., Sanderson, M.: Which User Interaction for Cross-Language IR? Design Issues and Reflections. JASIST special issue on Multilingual Information Access 57(5), 709–722 (2005)
Chin, J.P., Diehl, V.A., Norman, K.L.: Development of an instrument measuring user satisfaction of the human-computer interface. In: CHI 1998, pp. 213–218. ACM Press, New York (1998)
Gonzalo, J., Clough, P., Vallin, A.: Overview of the CLEF 2005 Interactive Track. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 251–262. Springer, Heidelberg (2006)
Van Welie, M., van der Veer, G.C., Eliens, A.: Breaking down Usability. In: Proc. INTERAC 1999, pp. 613–620 (1999)
Frokjaer, E., Hertzum, M., Hornbaek, K.: Measuring Usability: Are Effectiveness, Efficiency, and User Satisfaction Really Correlated? In: CHI 2000, pp. 345–352 (2000)
Author information
Authors and Affiliations
Department of Information Studies, University of Sheffield, Regent Court, 211 Portobello Street, Sheffield, S1 4DP, UK
Daniela Petrelli & Paul Clough
- Daniela Petrelli
You can also search for this author inPubMed Google Scholar
- Paul Clough
You can also search for this author inPubMed Google Scholar
Editor information
Editors and Affiliations
ISTI-CNR, Area di Ricerca, Pisa, Italy
Carol Peters
University of California, Berkeley, CA, USA
Fredric C. Gey
No Affiliations,
Julio Gonzalo
Business Information Systems, University of Applied Sciences, Sierre, Switzerland
Henning Müller
Centre for Digital Video Processing & School of Computing, Dublin City University, Dublin 9, Ireland
Gareth J. F. Jones
German Institute for International and Security Affairs, Stiftung Wissenschaft und Politik (SWP), Ludwigkirchplatz 3-4, 10719, Berlin, Germany
Michael Kluck
ITC-IRST, Trento, Italy
Bernardo Magnini
ISLA, University of Amsterdam,
Maarten de Rijke
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Petrelli, D., Clough, P. (2006). Using Concept Hierarchies in Text-Based Image Retrieval: A User Evaluation. In: Peters, C.,et al. Accessing Multilingual Information Repositories. CLEF 2005. Lecture Notes in Computer Science, vol 4022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11878773_35
Download citation
Publisher Name:Springer, Berlin, Heidelberg
Print ISBN:978-3-540-45697-1
Online ISBN:978-3-540-45700-8
eBook Packages:Computer ScienceComputer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative