ACM Digital Library home

  • Advanced Search

Journal of User Experience

Volume 18, Issue 4

August 2023

  • Usability Professionals' Association
  • 140 N. Bloomingdale Road
  • Bloomingdale
  • Empirical findings and case studies
  • Emerging methods and tools from within the user experience profession and from related disciplines, such as market research and technical communications
  • Approaches and case studies in UX education and training

Subject Areas

Announcements.

ACM Updates Its Peer Review Policy

ACM is pleased to announce that its Publications Board has approved an updated Peer Review Policy . If you have any questions regarding the update, the associated FAQ addresses topics such as confidentiality, the use of large language models in the peer review process, conflicts of interest, and several other relevant concerns. If there are any issues that are not addressed in the FAQ, please contact ACM’s Director of Publications, Scott Delman .

New ACM Policy on Authorship ACM has a new Policy on Authorship , covering a range of key topics, including the use of generative AI tools.  Please familiarize yourself with the new policy and the associated list of Frequently Asked Questions .

Most Frequent Affiliations

Most cited authors, latest issue.

  • Volume 18, Issue 4 August 2023 ISSN: 1931-3357 View Table of Contents

Designing User Interface Toggles for Usability

Metropolitan University, Postboks 4, St. Olavs plass, Oslo, Norway

Metropolitan University,, Postboks 4, St. Olavs plass, Oslo, Norway

Online User Reviews: A Treasure Trove of UX Research?

Dept. of Industrial and Information Systems Engineering, Soongsil University, Dongjak-Gu, Seoul, South Korea

Recent Award Winners

Most popular, other acm journals.

ACM Journal on Computing and Sustainable Societies cover image

Volume 2, Issue 2

Collective Intelligence cover image

Volume 3, Issue 2

April-June 2024

ACM Computing Surveys cover image

Volume 56, Issue 10

October 2024

Digital Government: Research and Practice cover image

Volume 5, Issue 2

Distributed Ledger Technologies: Research and Practice cover image

Volume 36, Issue 2

Export Citations

  • Please download or close your previous search result export first before starting a new bulk export. Preview is not available. By clicking download, a status dialog will open to start the export process. The process may take a few minutes but once it finishes a file will be downloadable from your browser. You may continue to browse the DL while the export process is in progress. Download
  • Download citation
  • Copy citation

We are preparing your search results for download ...

We will inform you here when the file is ready.

Your file of search results citations is now ready.

Your search export query has expired. Please try again.

Available 9 a.m.–5 p.m.

Additional Options

  • smartphone Call / Text
  • voice_chat Consultation Appointment
  • place Visit
  • email Email

Chat with a Specific library

  • Business Library Business Library Chat is Offline
  • College Library (Undergraduate) College Library Chat is Offline
  • Ebling Library (Health Sciences) Ebling Library Chat is Offline
  • Gender and Women's Studies Librarian GWS Library Chat is Offline
  • Information School Library (Information Studies) iSchool Library Chat is Offline
  • Law Library (Law) Law Library Chat is Offline
  • Memorial Library (Humanities & Social Sciences) Memorial Library Chat is Offline
  • MERIT Library (Education) MERIT Library Chat is Offline
  • Steenbock Library (Agricultural & Life Sciences, Engineering) Steenbock Library Chat is Offline
  • Ask a Librarian Hours & Policy
  • Library Research Tutorials

Search the for Website expand_more Articles Find articles in journals, magazines, newspapers, and more Catalog Explore books, music, movies, and more Databases Locate databases by title and description Journals Find journal titles UWDC Discover digital collections, images, sound recordings, and more Website Find information on spaces, staff, services, and more

Language website search.

Find information on spaces, staff, and services.

  • ASK a Librarian
  • Library by Appointment
  • Locations & Hours
  • Resources by Subject

book Catalog Search

Search the physical and online collections at UW-Madison, UW System libraries, and the Wisconsin Historical Society.

  • Available Online
  • Print/Physical Items
  • Limit to UW-Madison
  • Advanced Search
  • Browse by...

collections_bookmark Database Search

Find databases subscribed to by UW-Madison Libraries, searchable by title and description.

  • Browse by Subject/Type
  • Introductory Databases
  • Top 10 Databases

article Journal Search

Find journal titles available online and in print.

  • Browse by Subject / Title
  • Citation Search

description Article Search

Find articles in journals, magazines, newspapers, and more.

  • Scholarly (peer-reviewed)
  • Open Access
  • Library Databases

collections UW Digital Collections Search

Discover digital objects and collections curated by the UW Digital Collections Center .

  • Browse Collections
  • Browse UWDC Items
  • University of Wisconsin–Madison
  • Email/Calendar
  • Google Apps
  • Loans & Requests
  • Poster Printing
  • Account Details
  • Archives and Special Collections Requests
  • Library Room Reservations

Search the UW-Madison Libraries

Article search, virtual reality as an empirical research tool — exploring user experience in a real building and a corresponding virtual model.

  • Virtual reality (VR) allows for highly-detailed observations, accurate behavior measurements, and systematic environmental manipulations under controlled laboratory circumstances. It therefore has the potential to be a valuable research tool for studies in human–environment interaction, such as building usability studies and post- as well as pre-occupancy building evaluation in architectural research and practice. In order to fully understand VR as a valid environmental representation, it is essential to examine to what extent not only user cognition and behavior, but also users' experiences are analogous in real and virtual environments. This work presents a multi-method approach with two studies that investigated the correspondence of building users' experience in a real conference center and a highly-detailed virtual model of the same building as well as a third study that virtually implemented systematic redesigns to the existing building layout. In the context of reporting users' experiential building evaluations, this article discusses the potential, prerequisites and opportunities for the implementation of virtual environments as an empirical research tool in the field of human–environment interaction. Based on quantitative data, few statistically significant differences between ratings of the real and the virtual building were found; however analyses based on qualitative data revealed differences relating to atmospherics. The main conclusion of this article is that VR has a strong potential to be used as an empirical research tool in psychological and architectural research and that future studies could supplement behavioral validation. • We compare an existing, real building with a virtual model of the same building. • We focus on experiential qualities of the real and the virtual building. • We found few differences in quantitative analyses; yet several qualitative differences concerning Atmospherics were revealed. • We discuss prerequisites of implementing VR in architectural and psychological research, in the context of user experience. • We recommend VR as research tool in behavioral pre- and post-occupancy evaluation in architectural research.

Having Trouble?

If you are having trouble accessing the article, report a problem.

Physical Copies

Publication details.

  • ScienceDirect (Freedom Collection)
  • Building usability
  • Pre-occupancy evaluation
  • Real building
  • Research tool
  • User experience
  • Virtual reality (VR)

Additional Information

Library staff details, keyboard shortcuts, available anywhere, available in search results.

Information

  • Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

  • Active Journals
  • Find a Journal
  • Proceedings Series
  • For Authors
  • For Reviewers
  • For Editors
  • For Librarians
  • For Publishers
  • For Societies
  • For Conference Organizers
  • Open Access Policy
  • Institutional Open Access Program
  • Special Issues Guidelines
  • Editorial Process
  • Research and Publication Ethics
  • Article Processing Charges
  • Testimonials
  • Preprints.org
  • SciProfiles
  • Encyclopedia

sustainability-logo

Article Menu

  • Subscribe SciFeed
  • Recommended Articles
  • Google Scholar
  • on Google Scholar
  • Table of Contents

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

JSmol Viewer

An empirical study on user experience evaluation and identification of critical ux issues.

empirical research user experience

1. Introduction

  • UX takes a holistic perspective of the user–product interaction [ 15 ], including use of the products, as well as the meaning and emotion among users through their interactions with products [ 16 ].
  • UX focuses on both pragmatic values and hedonic value [ 6 ]. In general, UX studies explore the relationships between usability, symbolic, and aesthetic value for user experience with products.
  • UX emphasizes the importance of the context of use [ 2 ], as different usage contexts can result in different experiences.

2. Literature Review

3. research methods, 3.1. the limitations of existing methods, 3.2. introduction of two methods formats, 3.2.1. the attrakdiff questionnaire format, 3.2.2. the ux curve method format, 3.3. data analysis, 3.3.1. four ux dimension coordinate planes, 3.3.2. identifying critical ux issues based on quantitative data, 4. experimental section, 4.1. data collection, 4.1.1. first-time user experience, 4.1.2. the long-term user experience evaluation, 4.2. ux coordinate planes, 5. discussion and conclusions, author contributions, conflicts of interest.

  • Pine, B.J.; Gilmore, J.H. Gilmore. Welcome to the Experience Economy. Harvard Bus. Rev. 1998 , 76 , 97–105. [ Google Scholar ] [ CrossRef ]
  • Hassenzahl, M.; Tractinsky, N. User Experience—A Research Agenda. Behav. Inf. Technol. 2006 , 25 , 91–97. [ Google Scholar ] [ CrossRef ]
  • Lee, S.; Choi, J. Enhancing user experience with conversational agent for movie recommendation: Effects of self-disclosure and reciprocity. Int. J. Hum.-Comput. Stud. 2017 , 103 , 95–105. [ Google Scholar ] [ CrossRef ]
  • Feng, L.; Sun, B.; Wang, K.; Tsai, S.B. An Empirical Study on the Design of Digital Content Products from a Big Data Perspective. Sustainability 2018 , 10 , 3092. [ Google Scholar ] [ CrossRef ]
  • Manresa-Yee, C.; Ponsa, P.; Varona, J.; Perales, F.J. User experience to improve the usability of a vision-based interface. Interact. Comput. 2010 , 22 , 594–605. [ Google Scholar ] [ CrossRef ]
  • Hassenzahl, M. The Thing and I: Understanding the Relationship Between User and Product. In Funology: From Usability to Enjoyment ; Kluwer Academic Publishers: Dordrecht, The Netherlands, 2003; pp. 31–42. [ Google Scholar ]
  • Law, E.L.C.; Van Schaik, P.; Roto, V. Attitudes towards user experience (UX) measurement. Int. J. Hum.-Comput. Stud. 2014 , 72 , 526–541. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Bruseberg, A.; McDonagh-Philp, D. New product development by eliciting user experience and aspirations. Int. J. Hum.-Comput. Stud. 2001 , 55 , 435–452. [ Google Scholar ] [ CrossRef ]
  • Alben, L. Quality of Experience: Defining the Criteria for Effective Interaction Design. Interactions 1996 , 3 , 11–15. [ Google Scholar ] [ CrossRef ]
  • Van Schaik, P.; Ling, J. Modelling user experience with web sites: Usability, hedonic value, beauty and goodness. Interact. Comput. 2008 , 20 , 419–432. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Bosley, J.J. Creating a Short Usability Metric for User Experience (UMUX) Scale. Interact. Comput. 2013 , 25 , 317–319. [ Google Scholar ] [ CrossRef ]
  • Law, E.L.C.; Roto, V.; Hassenzahl, M.; Vermeeren, A.P.; Kort, J. Understanding, scoping and defining user experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA, 4–9 April 2009; pp. 719–728. [ Google Scholar ] [ CrossRef ]
  • Spohrer, J.; Stein, M. User Experience in the Pervasive Computing Age. IEEE Multimed. 2000 , 7 , 12–17. [ Google Scholar ] [ CrossRef ]
  • Wilson, G.M.; Angela Sasse, M. From doing to being: Getting closer to the user experience. Interact. Comput. 2004 , 16 , 697–705. [ Google Scholar ] [ CrossRef ]
  • Norman, D.A.; Nielsen, J. The Definition of User Experience (UX) ; Nielsen Norman Group Publication: Fremont, CA, USA, 2016; Available online: https://www.nngroup.com/articles/definition-user-experience/ (accessed on 12 April 2019).
  • Forlizzi, J.; Battarbee, K. Understanding experience in interactive systems. In Proceedings of the 5th conference on Designing interactive systems: Processes, practices, methods, and techniques, Cambridge, MA, USA, 1–4 August 2004; pp. 261–268. [ Google Scholar ] [ CrossRef ]
  • Bargas-Avila, J.A.; Hornbæk, K. Old wine in new bottles or novel challenges: A critical analysis of empirical studies of user experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada, 7–12 May 2011. [ Google Scholar ] [ CrossRef ]
  • Gençer, M.; Bilgin, G.; Zan, Ö.; Voyvodaoğlu, T. A new framework for increasing user engagement in mobile applications using machine learning techniques. In Proceedings of the International Conference on Design, Las Vegas, NV, USA, 21–26 July 2013. [ Google Scholar ] [ CrossRef ]
  • Park, J.; Han, S.H.; Kim, H.K.; Oh, S.; Moon, H. Modeling user experience: A case study on a mobile device. Int. J. Ind. Ergon. 2013 , 43 , 187–196. [ Google Scholar ] [ CrossRef ]
  • Law, E.L.C.; Abrahão, S. Interplay between User Experience (UX) evaluation and system development. Int. J. Hum.-Comput. Stud. 2014 , 72 , 523–525. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Olaverri-Monreal, C.; Hasan, A.E.; Bengler, K. Semi-automatic user stories generation: To measure user experience. In Proceedings of the 8th Iberian Conference on Information Systems and Technologies (CISTI), Lisboa, Portugal, 19–22 June 2013. [ Google Scholar ]
  • Marti, P.; Iacono, I. Anticipated, momentary, episodic, remembered: The many facets of User eXperience. In Proceedings of the Federated Conference on Computer Science and Information Systems (FedCSIS), Gdansk, Poland, 11–14 September 2016. [ Google Scholar ]
  • Ardito, C.; Buono, P.; Caivano, D.; Costabile, M.F.; Lanzilotti, R. Investigating and promoting UX practice in industry: An experimental study. Int. J. Hum.-Comput. Stud. 2014 , 72 , 542–551. [ Google Scholar ] [ CrossRef ]
  • Subramanya, S.R.; Yi, B.K. Enhancing the User Experience in Mobile Phones. Computer 2007 , 40 , 114–117. [ Google Scholar ] [ CrossRef ]
  • Aizpurua, A.; Harper, S.; Vigo, M. Exploring the relationship between web accessibility and user experience. Int. J. Hum.-Comput. Stud. 2016 , 91 , 13–23. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Karapanos, E.; Martens, J.B.; Hassenzahl, M. Reconstructing experiences with iScale. Int. J. Hum.-Comput. Stud. 2012 , 70 , 849–865. [ Google Scholar ] [ CrossRef ]
  • Karapanos, E.; Martens, J.B.O.; Hassenzahl, M. On the Retrospective Assessment of Users’ Experiences Over Time: Memory or Actuality? In Proceedings of the CHI 10 Extended Abstracts on Human Factors in Computing Systems, Atlanta, GA, USA, 10–15 April 2010. [ Google Scholar ] [ CrossRef ]
  • Prümper, J.O.C.H.E.N.; Zapf, D.; Brodbeck, F.C.; Frese, M. Some surprising differences between novice and expert errors in computerized office work. Behav. Inf. Technol. 1992 , 11 , 10. [ Google Scholar ] [ CrossRef ]
  • Karapanos, E.; Zimmerman, J.; Forlizzi, J.; Martens, J.B. User experience over time. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA, 4–9 April 2008. [ Google Scholar ] [ CrossRef ]
  • Kujala, S.; Roto, V.; Väänänen-Vainio-Mattila, K.; Karapanos, E.; Sinnelä, A. UX Curve: A method for evaluating long-term user experience. Interact. Comput. 2011 , 23 , 473–483. [ Google Scholar ] [ CrossRef ] [ Green Version ]
  • Kujala, S.; Miron-Shatz, T. The evolving role of expectations in long-term user experience. In Proceedings of the 19th International Academic Mindtrek Conference, Ampere, Finland, 22–24 September 2015. [ Google Scholar ] [ CrossRef ]
  • Hassenzahl, M.; Ullrich, D. To do or not to do: Differences in user experience and retrospective judgments depending on the presence or absence of instrumental goals. Interact. Comput. 2007 , 19 , 429–437. [ Google Scholar ] [ CrossRef ]
  • Von Wilamowitz-Moellendorff, M.; Hassenzahl, M.; Platz, A. Dynamics of user experience: How the perceived quality of mobile phones changes over time. In Proceedings of the Workshop at the Fourth Nordic Conference on Human-Computer Interaction, Oslo, Norway, 14 October 2006. [ Google Scholar ]
  • Kahneman, D.; Krueger, A.B.; Schkade, D.A.; Schwarz, N.; Stone, A.A. A survey method for characterizing daily life experience: The day reconstruction method. Science 2004 , 306 , 1776–1780. [ Google Scholar ] [ CrossRef ]
  • Kujala, S.; Roto, V.; Väänänen-Vainio-Mattila, K.; Sinnelä, A. Identifying hedonic factors in long-term user experience. In Proceedings of the Conference on Designing Pleasurable Products & Interfaces, Milano, Italy, 22–25 June 2011. [ Google Scholar ] [ CrossRef ]
  • Sonnemans, J.; Frijda, N.H. The structure of subjective emotional intensity. Cogn. Emot. 1995 , 8 , 329–350. [ Google Scholar ] [ CrossRef ]
  • Shiffman, S.; Stone, A.A.; Hufford, M.R. Ecolocial Momentary Assessment. Annu. Rev. Clin. Psychol. 2008 , 4 , 1–32. [ Google Scholar ] [ CrossRef ]
  • Hsee, C.K.; Hastie, R. Decision and experience: Why don’t we choose what makes us happy? Trends Cogn. Sci. 2006 , 10 , 31–37. [ Google Scholar ] [ CrossRef ]
  • Mandryk, R.L.; Inkpen, K.M.; Calvert, T.W. Using psychophysiological techniques to measure user experience with entertainment technologies. Behav. Inf. Technol. 2006 , 25 , 141–158. [ Google Scholar ] [ CrossRef ]
  • Garrett, J.J. Customer Loyalty and the Elements of User Experience. Des. Manag. Rev. 2010 , 17 , 35–39. [ Google Scholar ] [ CrossRef ]
  • Montague, E.; Xu, J. Understanding Active and Passive Users: The Effects of an Active User Using Normal, Hard and Unreliable Technologies on User Assessment of Trust in Technology and Co-User. Appl. Ergon. 2012 , 43 , 702–712. [ Google Scholar ] [ CrossRef ]
  • Hassenzahl, M. The interplay of beauty, goodness, and usability in interactive products. Hum. Comput. Interact. 2004 , 19 , 319–349. [ Google Scholar ] [ CrossRef ]
  • Leanplum. Retention Revealed; Leanplum Publication . 2016. Available online: https://www.leanplum.com/trends/retention-revealed/ (accessed on 12 April 2019).

Click here to enlarge figure

FeatureParticipant Distribution
Gender50.0% Female
50.0% Male
Age10.0% Under 20 years old
25.0% 20–24 years old
30.0% 25–29 years old
25.0% 30–34 years old
5.0% 35–39 years old
5.0% 40–44 years old
Education15.0% High school
50.0% Bachelor’s degree
30.0% Master’s degree
5.0% Other (Ph. D, Professional Course, Uneducated, etc.)
Occupation60.0% Employee
10.0% Freelance
20.0% Student
10.0% Unemployed
Phone OS30.0% iOS
70.0% Android
Score BandPQHQ-IHQ-SATT
−32101
−24425
−15535
04443
13353
22252
30111
Mean Value−0.6 (s = 1.5)−0.3 (s = 1.6)0.6 (s = 1.4)−0.4 (2 = 1.6)
The First-Time UX
Pragmatic IssuesHedonic Issues
Crash bugs (5 times)Social sharing (4 times)
Long registration process (4 times)Limited workout options (3 times)
Restricted Connection (3 times)Unpleasant designs (2 times)
DifferencePQHQ-IHQ-SATT
Positive7 (35%)11 (55%)10 (50%)9 (45%)
Negative10(50%)6 (30%)5 (25%)7 (35%)
Zero3 (65%)3 (15%)5 (25%)4 (20%)
The Long-Term UX
Pragmatic IssuesHedonic Issues
Crash bugs (8 times)Too much notification (5 times)
Unable to sync activity data (5 times)Limited workout options (5 times)
Battery drain (4 times)Restricted social sharing (4 times)

Share and Cite

Feng, L.; Wei, W. An Empirical Study on User Experience Evaluation and Identification of Critical UX Issues. Sustainability 2019 , 11 , 2432. https://doi.org/10.3390/su11082432

Feng L, Wei W. An Empirical Study on User Experience Evaluation and Identification of Critical UX Issues. Sustainability . 2019; 11(8):2432. https://doi.org/10.3390/su11082432

Feng, Lin, and Wei Wei. 2019. "An Empirical Study on User Experience Evaluation and Identification of Critical UX Issues" Sustainability 11, no. 8: 2432. https://doi.org/10.3390/su11082432

Article Metrics

Article access statistics, further information, mdpi initiatives, follow mdpi.

MDPI

Subscribe to receive issue release notifications and newsletters from MDPI journals

  • DOI: 10.1016/j.compenvurbsys.2015.09.006
  • Corpus ID: 19229959

Virtual reality as an empirical research tool - Exploring user experience in a real building and a corresponding virtual model

  • S. Kuliga , Tyler Thrash , +1 author C. Hölscher
  • Published in Computers, Environment and… 1 November 2015
  • Engineering, Environmental Science, Computer Science

297 Citations

Virtual reality as a tool to investigate and predict occupant behaviour in the real world: the example of wayfinding.

  • Highly Influenced

A Systematic Review of the Potential Application of Virtual Reality Within a User Pre-occupancy Evaluation

User environment perception in hmd-based immersive virtual reality context, usability studies on building early stage architectural models in virtual reality, assessing heuristic evaluation in immersive virtual reality - a case study on future guidance systems, a design review session protocol for the implementation of immersive virtual reality in usability-focused analysis, scale estimation for design decisions in virtual environments: understanding the impact of user characteristics on spatial perception in immersive virtual reality systems, exploring the future building: representational effects on projecting oneself into the future office space, understanding the effects of virtual reality system usage on spatial perception: the potential impacts of immersive virtual reality on spatial design decisions, immersive environment for improving the understanding of architectural 3d models: comparing user spatial perception between immersive and traditional virtual reality systems, 45 references, users' evaluation of a virtual reality architectural model compared with the experience of the completed building, comparing human wayfinding behavior in real and virtual environment, design and evaluation of a real-world virtual environment for architecture and urban planning, virtual laboratories: comparability of real and virtual environments for environmental psychology, see-through techniques for referential awareness in collaborative virtual reality, virtual spaces and real world places: transfer of route knowledge, navigating buildings in "desk-top" virtual environments: experimental investigations using extended navigational experience, immersive virtual environment technology as a basic research tool in psychology, estimating distance in real and virtual environments: does order make a difference, subjective responses to simulated and real environments: a comparison, related papers.

Showing 1 through 3 of 0 Related Papers

Empirical User Study

  • First Online: 23 March 2016

Cite this chapter

empirical research user experience

  • Kawa Nazemi 3  

Part of the book series: Studies in Computational Intelligence ((SCI,volume 646))

759 Accesses

The conceptual model, designed and implemented in context of this work, requires to be proved and validated. Furthermore, shortcomings and limitations of the approach should be enlightened to enable future work for the community on this topic.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
  • Available as EPUB and PDF
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
  • Durable hardcover edition

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

J.D. Fekete, J. van Wijk, J. Stasko, C. North, Information Visualization pp. 1–18 (2008)

Google Scholar  

D. Keim, J. Kohlhammer, G. Ellis, F. Mansmann, Matering the Information Age Solving Problems with Visual Analytics (Eurographics Association, 2010)

S.K. Card, J.D. Mackinlay, B. Shneiderman, Readings in Information Visualization: Using Vision to Think , 1st edn. (Morgan Kaufmann, 1999). http://www.amazon.com/exec/obidos/redirect?tag=citeulike07-20&path=ASIN/1558605339

J.W. Ahn, Adaptive visualization for focused personalized information retrieval. Ph.D. thesis, School of Information Sciences, University of Pittsburgh (2010). http://etd.library.pitt.edu/ETD/available/etd-08262010-150850/

L.C. Koh, A. Slingsby, J. Dykes, T.S. Kam, in 2010 14th International Conference Information Visualisation 0 (2011), p. 90. http://doi.ieeecomputersociety.org/10.1109/IV.2011.32

G.G. Grinstein, P. Hoffman, R.M. Pickett, S.J. Laskowski, Information Visualization in Data Mining and Knowledge Discovery , pp. 129–176 (2002)

C. Plaisant, J.D. Fekete, G. Grinstein, IEEE Trans. Vis. Comput. Graph. 14 (1), 120 (2008). doi: 10.1109/TVCG.2007.70412

Article   Google Scholar  

B.S. Santos, position paper (2005). http://www.dis.uniroma1.it/beliv08/pospap/santos.pdf

J.J. Van Wijk, in Visualization, VIS 05 , (IEEE, 2005), pp. 79–86

S. Carpendale, Information Visualization , pp. 19–45 (2008)

E.W. Anderson, K.C. Potter, L.E. Matzen, J.F. Shepherd, G.A. Preston, C.T. Silva, Comput. Graph. Forum 30 (3), 791 (2011). doi: 10.1111/j.1467-8659.2011.01928.x

B. Steichen, G. Carenini, C. Conati, in Proceedings of the 2013 International Conference on Intelligent User Interfaces (ACM, New York, NY, USA, 2013), IUI ’13, pp. 317–328. doi: 10.1145/2449396.2449439 . http://doi.acm.org

C. Plaisant, in Proceedings of the Working Conference on Advanced Visual Interfaces , pp. 109–116 (2004)

A. Komlodi, A. Sears, E. Stanziola, Information visualization evaluation review. Technical report, ISRC Tech. Report, Department of Information Systems, UMBC. UMBC-ISRC-2004-1 (2004)

J. Lazar, J. Feng, H. Hochheiser, Research Methods in Human-Computer Interaction (Wiley, Indianapolis, 2010)

T. Zuk, L. Schlesier, P. Neumann, M.S. Hancock, S. Carpendale, in Proceedings of the 2006 AVI Workshop on BEyond Time and Errors: Novel Evaluation Methods for Information Visualization, pp. 1–6 (2006)

J.L. Gabbard, K. Swartz, K. Richey, D. Hix, Simulation Series 31 (1999)

A. Falk, J.J. Heckman, Science 326 (5952), 535 (2009)

H. Lam, E. Bertini, P. Isenberg, C. Plaisant, S. Carpendale, Technical report 2011, University of Calgary (2011)

A. Veerasamy, N.J. Belkin, in Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval , pp. 85–92 (1996)

O.I.d. Normalizacion, ISO Guide 34 General Requirements for the Competence of Reference Material Producers (ISO, 2000)

D. Sprague, M. Tory, Motion in casual InfoVis and the interrelation between personality, performance, and preference. Technical report, University of Victoria. British Columbia, Canada (2009)

A.M. Treisman, G. Gelade, Cogn. Psychol. 12 (1), 97 (1980)

J.M. Wolfe, W. Gray (Ed.), Integr. Models Cognitive Syst. 99–119 (2007)

C. Ware, Information Visualization Perception for Design (Morgan Kaufmann Publishers, 2004)

C. Ware, Information Visualization Perception for Design (Morgan Kaufmann (Elsevier), 2013)

R.A. Rensink, Ann. Rev. Psychol. 53 , 245 (2002)

A.M. Treisman, Sci. Am. 255 , 106 (1986)

A.M. Treisman, S. Gormican, Psychol. Rev. 95 (1), 15 (1988)

J.M. Wolfe, J. Exp. Psychol. Hum. Percept. Perform. 15 (3), 419 (1989)

J.M. Wolfe, Psychon. Bull. Rev. 1 (2), 202 (1994)

J. Wolfe, T.S. Horowitz, Scholarpedia 3 (7), 3325 (2008)

E. Jun, S. Landry, G. Salvendy, Int. J. Human Comput. Inter. 27 (4), 348 (2011)

R.A. Rensink, Vis. Cogn. 7 , 17 (2000)

S. Kyllingsbàek, Behav. Res. Methods 38 (1), 123 (2006)

G.D. Logan, Ann. Rev. Psychol. 55 (1), 207 (2004). doi: 10.1146/annurev.psych.55.090902.141415

Article   MathSciNet   Google Scholar  

K. Nazemi, J. Kohlhammer, in 1st International Workshop on User-Adaptive Visualization (WUAV 2013). Extended Proceedings of UMAP 2013, CEUR Workshop Proceedings. ISSN 1613–0073, vol. 997 (2013), CEUR Workshop Proceedings. ISSN 1613–0073, vol. 997

P. Downing, C. Dodds, Visual Cogn. 11 (6), 689 (2004). doi: 10.1080/13506280344000446

C. Lucas, J. Lauwereyns, Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) 54 (4), 256 (2007). doi: 10.1027/1618-3169.54.4.256

N. Lavie, Visual Cogn. 14 (4–8), 863 (2006). doi: 10.1080/13506280500195953

J. Somervell, D.S. McCrickard, C. North, M. Shukla, in Proceedings of the Symposium on Data Visualisation 2002 , pp. 211–216 (2002)

V. Aginsky, B.U. IV, M.J. Tarr, Visual Cogn. 7 (1–3), 147 (2000)

L. Matzen, L. McNamara, K. Cole, A. Bandlow, C. Dornburg, T. Bauer, in BELIV’10: BEyond time and errors: novel evaLuation methods for Information Visualization . Workshop of the ACM CHI 2010 (2010)

C. Conati, H. Maclaren, in Proceedings of the Working Conference on Advanced Visual Interfaces (ACM, New York, NY, USA, 2008), AVI ’08, pp. 199–206. doi: 10.1145/1385569.1385602 . http://doi.acm.org/10.1145/1385569.1385602

C. Conati, G. Carenini, M. Harati, D. Tocker, N. Fitzgerald, A. Flagg, in AAAI Workshops (2011). http://www.aaai.org/ocs/index.php/WS/AAAIW11/paper/view/3944

D. Ullrich, S. Diefenbach, in Mensch & Computer 2010: 10. Fachübergreifende Konferenz für interaktive und kooperative Medien. Interaktive Kulturen (Oldenbourg Wissenschaftsverlag, 2010), p. 251

D. Ullrich, S. Diefenbach, in Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (ACM, 2010), pp. 801–804

J.W. Ahn, P. Brusilovsky, in User Modeling, Adaptation, and Personalization, Lecture Notes in Computer Science , ed. by P. Bra, A. Kobsa, D. Chin, vol. 6075 (Springer, Berlin, 2010), pp. 4–15. doi: 10.1007/978-3-642-13470-8_3

I.R. Olson, M.M. Chun, Visual Cogn. 9 (3), 273 (2002). doi: 10.1080/13506280042000162

D. Toker, C. Conati, G. Carenini, M. Haraty, in User Modeling, Adaptation, and Personalization, Lecture Notes in Computer Science , ed. by J. Masthoff, B. Mobasher, M. Desmarais, R. Nkambou, vol. 7379 (Springer, Berlin, 2012), pp. 274–285. doi: 10.1007/978-3-642-31454-4_23

D. Toker, C. Conati, B. Steichen, G. Carenini, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM, New York, NY, USA, 2013), CHI ’13, pp. 295–304. doi: 10.1145/2470654.2470696 . http://doi.acm.org/10.1145/2470654.2470696

B. Steichen, G. Carenini, C. Conati, in UMAP Workshops, CEUR Workshop Proceedings , ed. by E. Herder, K. Yacef, L. Chen, S. Weibelzahl, vol. 872 (CEUR-WS.org, 2012), CEUR Workshop Proceedings, vol. 872. http://dblp.uni-trier.de/db/conf/um/umap2012w.html

B. Steichen, O. Schmid, C. Conati, G. Carenini, in UMAP 2013 Extended Proceedings. First International Workshop on User-Adaptive Visualizations (WUAV 2013) (2013)

G. Marchionini, Commun. ACM 49 (4), 41 (2006). doi: 10.1145/1121949.1121979 . http://doi.acm.org/10.1145/1121949.1121979

R.W. White, R.A. Roth, Exploratory Search: Beyond the Query-Response Paradigm, Synthesis Lectures on Information Concepts, Retrieval, and Services. G. Marchionini (Ed), vol. 1 (Morgan & Claypool Publishers, 2009). doi: 10.2200/s00174ed1v01y200901icr003

D. Simkin, R. Hastie, J. Am. Stat. Assoc. 82 (398), 454 (1987). doi: 10.1080/01621459.1987.10478448

S. Few, Information Management Magazine (2005)

S. Koshman, A. Spink, B.J. Jansen, C. Blakely, J. Weber, in Canadian Association for Information Science Conference (2006)

J. Gemmell, G. Bell, R. Lueder, S. Drucker, C. Wong, in Proceedings of the tenth ACM international conference on Multimedia , pp. 235–238 (2002)

P. Zhang, in Proceedings of The Second Americas Conference on Information Systems (AIS’96) (1996), pp. 16–18

G. Kiczales, ACM Comput. Surv. (CSUR) 28(4es), 154 (1996)

L. Chittaro, C. Combi, in Proceedings of the Eighth International Symposium on Temporal Representation and Reasoning, 2001. TIME 2001 (2001), pp. 13–20

T. Lavie, N. Tractinsky, Int. J. Hum.-Comput. Stud. 60 (3), 269 (2004). doi: 10.1016/j.ijhcs.2003.09.002

N. Cawthon, A.V. Moere, in Information Visualization, 2007. IV’07. 11th International Conference (2007), pp. 637–648

E. Michailidou, S. Harper, S. Bechhofer, in Proceedings of the 26th Annual ACM International Conference on Design of Communication (2008), pp. 215–224

K. Nazemi, C. Stab, A. Kuijper, in Human-Computer Interaction. Design and Development Approaches, Lecture Notes in Computer Science , ed. by J. Jacko, vol. 6761 (Springer, 2011), pp. 480–489. doi: 10.1007/978-3-642-21602-2_52

K. Nazemi, R. Retz, J. Bernard, J. Kohlhammer, D. Fellner, in Advances in Visual Computing, Lecture Notes in Computer Science , ed. by G. Bebis, R. Boyle, B. Parvin, D. Koracin, B. Li, F. Porikli, V. Zordan, J. Klosowski, S. Coquillart, X. Luo, M. Chen, D. Gotz, vol. 8034 (Springer, Berlin, 2013), pp. 13–24. doi: 10.1007/978-3-642-41939-3_2

Freebase consortium. Freebase—a community-curated database of well-known people, places, and things (2013). http://www.freebase.com/ . Accessed Aug 2013

J. Waniek, H. Langner, F. Schmidsberger, in Special Interest Tracks and Posters of the 14th international Conference on World Wide Web (2005), pp. 900–901

T. Richter, J. Naumann, N. Groeben, Comput. Human Behav. 16 (5), 473 (2000)

R.M. Hogarth, Educating Intuition (University of Chicago Press, Chicago, 2001)

C. Chen, Y. Yu, Int. J. Human-Comput. Stud. 53 (5), 851 (2000). doi: 10.1006/ijhc.2000.0422

T. Richter, J. Naumann, N. Groeben, Das Inventar zur Computerbildung (INCOBI): Ein Instrument zur Erfassung von Computer Literacy und computerbezogenen Einstellungen bei Studierenden der Geistes-und Sozialwissenschaften (Reinhardt, 2001)

B.S. Bloom, Taxonomy of Educational Objectives (David McKay Co., Inc., New York, 1956)

Eurographics Consortium. Eurographics digital library (2013). https://diglib.eg.org

F.G. Giesbrecht, M.L. Gumpertz, Latin Squares (John Wiley & Sons Inc, 2005), pp. 118–157. doi: 10.1002/0471476471.ch6

F. Faul, E. Erdfelder, A.G. Lang, A. Buchner, Behav. Res. Methods 39 , 1149 (2007)

F. Faul, E. Erdfelder, A. Buchner, A.G. Lang, Behav. Res. Methods 41 , 1149 (2009)

C. Summerfield, T. Egner, Trends Cogn. Sci. 13 (9), 403 (2009). doi: 10.1016/j.tics.2009.06.003

M. Hassenzahl, M. Burmester, F. Koller, in Mensch & Computer 2003 (Springer, 2003), pp. 187–196

P. Baghaei, N. Amrahi, Psychol. Test Assess. Model. 53 (2011)

T.M. Haladyna, S.M. Downing, M.C. Rodriguez, Appl Measur. Educ. 15 (3), 309 (2002)

T.E. Wilens, M.H. Verlinden, L.A. Adler, P.J. Wozniak, S.A. West, Bio. Psychiatry 59 (11), 1065 (2006). doi: 10.1016/j.biopsych.2005.10.029 . http://www.sciencedirect.com/science/article/pii/S0006322305014423

T. Kirk, J.D. Roache, R.R. Griffiths, J. Clin. Psychopharmacol. 10 (3), 160 (1990). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=1991-00697-001&site=ehost-live

D.R. Jasinski, J. Psychopharmacol. 14 (1), 53 (2000). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2000-08187-007&site=ehost-live

H.W. Reese, J. Exp. Child Psychol. 64 (1), 137 (1997). doi: 10.1006/jecp.1996.2333 . http://www.sciencedirect.com/science/article/pii/S0022096596923334

J. Gaito, Psychometrika 23 (4), 369 (1958). doi: 10.1007/BF02289785

R.P. Hamlin, Eur. J. Mark. 39 (3–4), 328 (2005). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2005-08599-006&site=ehost-live

D.J. Steele, J.D. Medder, P. Turner, Med. Educ. 34 (1), 23 (2000). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2000-13244-002&site=ehost-live

K.A.D. Stahl, J. Literacy Res. 40 (3), 359 (2008). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2009-09317-004&site=ehost-live

J. Meijer, R. Oostdam, Anxiety, Stress Coping Int. J. 20 (1), 77 (2007). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2007-04652-007&site=ehost-live

J. Giles, D.A.J. Ryan, G. Belliveau, E. De Freitas, R. Casey, Act. Learn. High. Educ. 7 (3), 213 (2006). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2006-13309-002&site=ehost-live

H.N.J. Schifferstein, K.S.S. Talke, D.J. Oudshoorn, Chemosens. Percept. 4 (1–2), 55 (2011). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2011-11665-007&site=ehost-live

G. Öquist, M. Goldstein, in Human Computer Interaction with Mobile Devices, Lecture Notes in Computer Science , ed. by F. Paternó (Springer, Berlin, 2002), pp. 225–240. doi: 10.1007/3-540-45756-9_18

S. Buisine, J.C. Martin, Interact. Comput. 19 (4), 484 (2007). http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2007-10838-004&site=ehost-live

M. Breyer, J. Birkenbusch, D. Burkhardt, C. Schwarz, C. Stab, K. Nazemi, O. Christ, in Advances in Affective and Pleasurable Design (Taylor & Francis, CRC Press, Boca Raton, 2012), Advances in Human Factors and Ergonomics Series. Proceedings of the 4th AHFE Conference; 14, pp. 8066–8074. http://bibcd.igd.fraunhofer.de/bibcd/INI_Science/papers/2012/12p057.pdf

M. Hassenzahl, M. Burmester, F. Koller, in Usability Professionals 2008 , ed. by H. Brau, S. Diefenbach, M. Hassenzahl, F. Koller, M. Peissner, K. Röse (Stuttgart: German Chapter der Usability Professionals Association, 2008), pp. 78–82

I. Torre, User Model. User-Adap. Inter. 19 (5), 433 (2009). doi: 10.1007/s11257-009-9067-3

G. Fiotakis, D. Raptis, N. Avouris, in Human-Computer Interaction at INTERACT 2009, Lecture Notes in Computer Science , ed. by T. Gross, J. Gulliksen, P. Kotz, L. Oestreicher, P. Palanque, R. Prates, M. Winckler, vol. 5726 (Springer, Berlin, 2009), pp. 231–234. doi: 10.1007/978-3-642-03655-2_27

M. Tory, T. Möller, A model-based visualization taxonomy. Technical. report. CMPT-TR2002-06, Computing Science Department, Simon Fraser University (2002)

J.W. Ahn, P. Brusilovsky, Inf. Vis. 8 8 (3), 180 (2009). http://ivi.sagepub.com/cgi/content/short/8/3/167

J.W. Ahn, P. Brusilovsky, Inf. Process. Manage. 49 (5), 1139 (2013). doi: 10.1016/j.ipm.2013.01.007 . urlhttp://www.sciencedirect.com/science/article/pii/S0306457313000137

Download references

Author information

Authors and affiliations.

Competence Center Information Visualization and Visual Analytics, Fraunhofer Institute for Computer Graphics Research (Fraunhofer IGD), Darmstadt, Germany

Kawa Nazemi

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Kawa Nazemi .

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Nazemi, K. (2016). Empirical User Study. In: Adaptive Semantics Visualization. Studies in Computational Intelligence, vol 646. Springer, Cham. https://doi.org/10.1007/978-3-319-30816-6_8

Download citation

DOI : https://doi.org/10.1007/978-3-319-30816-6_8

Published : 23 March 2016

Publisher Name : Springer, Cham

Print ISBN : 978-3-319-30815-9

Online ISBN : 978-3-319-30816-6

eBook Packages : Engineering Engineering (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Publish with us

Policies and ethics

  • Find a journal
  • Track your research

Northumbria University Research Portal Logo

Virtual Reality as an Empirical Research Tool - Exploring User Experience in a Real Building and a Corresponding Virtual Model

  • Architecture and Built Environment

Research output : Contribution to journal › Article › peer-review

Original languageEnglish
Pages (from-to)363-375
Journal
Volume54
Early online date17 Oct 2015
DOIs
Publication statusPublished - 1 Nov 2015

Access to Document

  • 10.1016/j.compenvurbsys.2015.09.006

Fingerprint

  • Virtual Environments Computer Science 100%
  • Environmental Manipulation Computer Science 100%
  • Environment Interaction Computer Science 50%
  • Usability Study Computer Science 50%

T1 - Virtual Reality as an Empirical Research Tool - Exploring User Experience in a Real Building and a Corresponding Virtual Model

AU - Kuliga, Saskia Felizitas

AU - Thrash, T.

AU - Dalton, Ruth

AU - Hoelscher, Christoph

PY - 2015/11/1

Y1 - 2015/11/1

N2 - Virtual reality allows highly-detailed observations, accurate behavior measurements, and systematic environmental manipulations under controlled laboratory circumstances. Therefore, it has the potential to be a valuable research tool for studies in human-environment interaction and ‘pre-occupancy' building evaluation. In order to fully understand VR as a valid environmental Virtual reality (VR) allows for highly-detailed observations, accurate behavior measurements, and systematic environmental manipulations under controlled laboratory circumstances. It therefore has the potential to be a valuable research tool for studies in human–environment interaction, such as building usability studies and post- as well as pre-occupancy building evaluation in architectural research and practice. In order to fully understand VR as a valid environmental representation, it is essential to examine to what extent not only user cognition and behavior, but also users' experiences are analogous in real and virtual environments. This work presents a multi-method approach with two studies that investigated the correspondence of building users' experience in a real conference center and a highly-detailed virtual model of the same building as well as a third study that virtually implemented systematic redesigns to the existing building layout. In the context of reporting users' experiential building evaluations, this article discusses the potential, prerequisites and opportunities for the implementation of virtual environments as an empirical research tool in the field of human–environment interaction. Based on quantitative data, few statistically significant differences between ratings of the real and the virtual building were found; however analyses based on qualitative data revealed differences relating to atmospherics. The main conclusion of this article is that VR has a strong potential to be used as an empirical research tool in psychological and architectural research and that future studies could supplement behavioral validation.

AB - Virtual reality allows highly-detailed observations, accurate behavior measurements, and systematic environmental manipulations under controlled laboratory circumstances. Therefore, it has the potential to be a valuable research tool for studies in human-environment interaction and ‘pre-occupancy' building evaluation. In order to fully understand VR as a valid environmental Virtual reality (VR) allows for highly-detailed observations, accurate behavior measurements, and systematic environmental manipulations under controlled laboratory circumstances. It therefore has the potential to be a valuable research tool for studies in human–environment interaction, such as building usability studies and post- as well as pre-occupancy building evaluation in architectural research and practice. In order to fully understand VR as a valid environmental representation, it is essential to examine to what extent not only user cognition and behavior, but also users' experiences are analogous in real and virtual environments. This work presents a multi-method approach with two studies that investigated the correspondence of building users' experience in a real conference center and a highly-detailed virtual model of the same building as well as a third study that virtually implemented systematic redesigns to the existing building layout. In the context of reporting users' experiential building evaluations, this article discusses the potential, prerequisites and opportunities for the implementation of virtual environments as an empirical research tool in the field of human–environment interaction. Based on quantitative data, few statistically significant differences between ratings of the real and the virtual building were found; however analyses based on qualitative data revealed differences relating to atmospherics. The main conclusion of this article is that VR has a strong potential to be used as an empirical research tool in psychological and architectural research and that future studies could supplement behavioral validation.

KW - user experience

KW - pre-occupancy evaluation

KW - ral building

KW - research tool

KW - building usability

U2 - 10.1016/j.compenvurbsys.2015.09.006

DO - 10.1016/j.compenvurbsys.2015.09.006

M3 - Article

SN - 0198-9715

JO - Computers, Environment and Urban Systems

JF - Computers, Environment and Urban Systems

Table of Contents

Collaboration, information literacy, writing process, usability and user experience research.

  • © 2023 by Guiseppe Getto

Usability is the art of making sure that any kind of communication deliverable (e.g. a website, a handbook, a user guide, etc.) is intuitive, easy-to-use , and helps users achieve their goals. Usability is part of the broader discipline known as User Experience Design (or UX), which encompasses all aspects of the look, feel, and information contained in a communication deliverable. Usability testing, the process by which a communication deliverable is assessed, however, remains at the core of this discipline.

Traditionally, usability has been a practice utilized by software designers and engineers to test complex technologies before they go to market. In order to perform usability testing, test users that fit the basic demographics of target consumers (e.g. age, region, occupation, languages spoken, disability status, etc.) are recruited. These test users are organized into “user segments” or demographic groups that fit particular criteria (e.g. young adult, Midwestern college students who speak English as a second language). Test users are then run through a battery of tests to ensure that the technology being developed is functional.

With the publication of Jakob Nielsen’s Usability Engineering in 1993 ( http://www.nngroup.com/books/usability-engineering/ ), however, this process began to evolve. Test users are now recruited earlier in the design process and thus have more of an impact on the shape the technology in development takes. In addition, Nielsen has developed five factors for judging whether a given communication deliverable is usable or not:

  • Learnability: How easy is it for users to accomplish basic tasks the first time they encounter the design?
  • Efficiency: Once users have learned the design, how quickly can they perform tasks?
  • Memorability: When users return to the design after a period of not using it, how easily can they reestablish proficiency?
  • Errors: How many errors do users make, how severe are these errors, and how easily can they recover from the errors?
  • Satisfaction: How pleasant is it to use the design?

Source: http://www.nngroup.com/articles/usability-101-introduction-to-usability/ .

Since the World Wide Web has become a primary means of communication and commerce, and the website has become one of the primary communication deliverables that usability researchers are concerned with. With the dramatic increase in information available to users of the Web, new methods have also been created for assessing the value of this information.

Michael Albers, a leader in the area of information design, has developed the following heuristic for what he calls “multidimensional audience analysis,” or the process of assessing how people make use of information (Albers, M. J., 2003). Multidimensional Audience Analysis for Dynamic Information. Journal Of Technical Writing & Communication, 33(3), (pp. 268-9).

  • Knowledge dimension: What subject matter expertise do users need to understand the information being presented?
  • Detail dimension: How much specific detail does the user want regarding the information they are seeking?
  • Cognitive ability: What is the reading ability and education level of the user. Do they have any physical or mental limitations that may affect their ability to understand the information?
  • Social or cultural aspects: What is the social or cultural background of the user, and how does that impact their use of the information.

As Rex Hartson and Pardha Pyla explain in The UX Book: Process and Guidelines for Ensuring a Quality User Experience, the broader discipline of UX also includes such aspects of communication as:

  • visual design of webpages and other types of interfaces
  • information architecture or ways information is organized and displayed
  • content strategy or plans for the development and distribution of effective content within webpages and social media
  • user research or in-depth field studies into the culture of workplaces and other places users dwell
  • usability testing or rigorous testing with test users similar to what Nielsen developed
  • accessibility or ensuring that technology is usable by persons with disabilities

Usability and User Experience Research

Figure 1: Essentials of User Experience

At its core, however, UX is still primarily concerned with ensuring that users have a satisfying, error-free experience with technology. Within the field of technical communication, movements like Plain Language have also sought to improve all forms of written communication so that documentation is universally understandable by any audience. Similarly, the adoption of Section 508 regulations require that all federal- and state-maintained websites are accessible to persons with disabilities.

[ Federal Plain Language Guidelines ]

UX is also driven by the world of business. Nearly every major corporation employs teams of UX professionals in the design and deployment of their website. Mobile applications designed by companies are rigorously tested to ensure that they are compelling to target consumers. Emerging technologies like wearable body sensors are created and tested in corporate labs the world over. In truth, the non-profit, governmental, and education spheres have lagged behind in the usage and employment of UX professionals. Regardless, it is estimated that even in the for-profit world, as much as 97% of websites fail at basic usability ( http://blogs.forrester.com/adele_sage/12-03-15-lessons_learned_from_1500_website_user_experience_reviews ).

Concerning the most common usability problems with websites, Jakob Nielsen has identified ten:

  • Using fonts that are too small or are difficult to read
  • Creating links that don’t clearly signal to users that they are links
  • Using Flash
  • Creating content that is too lengthy and wordy
  • Using search engines that don’t work properly
  • Creating websites that don’t work properly with the most common Internet browsers (e.g. Internet Explorer, Chrome, Firefox, and Safari).
  • Using web forms that don’t work property (e.g. asking users to create password, but not clearly explaining what kinds of characters are required)
  • Not including contact information for the organization who created and/or maintains the site
  • Not including images that are large enough for users to see clearly

(via http://www.nngroup.com/articles/top-ten-web-design-mistakes-of-2005/ )

As far as activities that UX professionals perform on a daily basis, usability testing remains a primary one. Any form of communication deliverable can be usability tested using steps like the following:

  • Define goals or tasks that users should be able to complete with the communication deliverable. Examples might include finding a certain piece of information, signing up for a newsletter, learning how to use your new smartphone, or setting up an account. A sound usability test asks users to complete about 7-10 major tasks. You should also include users in this step by conducting some preliminary interviews to uncover what goals users have for the type of deliverable you’re testing (e.g. a college website, a flyer for a student organization, the information contained in a piece of technology such as a smartphone or tablet, etc.).
  • Write each of your tasks down as imperative sentences that you will read to users. Examples might include “sign up for the organization’s newsletter,” or “learn how to sign up for a class.” Each sentence should be simple enough to be easily understood by users, but should represent a task that is a key goal of the communication deliverable.
  • Recruit people who fit the primary demographics of the target audiences for the communication deliverable. You should try to recruit at least 5 total users, and if you have a lot of different user segments (e.g. different ages, regions, occupations, languages spoken, or disability status), you should make sure you recruit at least one person from each segment.
  • Meet with each user and two researchers to run your usability tests. One researcher should lead the user through the task and should ask the user why they completed each task in the way that they did, or what they thought about while they were completing the task (you can ask participants to do this while they’re completing each task, after they complete each task, or at the end of the test. There are pros and cons to each approach: http://www.usability.gov/how-to-and-tools/methods/running-usability-tests.html ). The other researcher should take detailed notes on what users struggled with, what they enjoyed, and overall impressions of the test. There are also various technologies available to help you record usability tests: .
  • Analyze your results. Try to identify patterns in user responses to your communication deliverable. Also pay attention to differences between individual users and try to identify the source of these differences. Many times, differences in the ways users respond are key to understanding the needs of specific user segments.
  • Use your results to improve the user experience of your communication deliverable by improving aspects of it that users struggled with and emphasizing aspects they enjoyed. Future testing is recommended as well. UX is an ongoing process. Like all forms of writing and communication, it’s never really finished.

In conclusion, UX is really a complex series of research methods that, individually, require years to learn. That being said, all communicators should know a little bit about UX to ensure that they are communicating in ways that are usable to their target audiences. The following resources offer a large amount of free information on how to create usable, accessible communication deliverables.

UX Resources

Usability.gov ( http://www.usability.gov/ ) – “User experience (UX) focuses on having a deep understanding of users, what they need, what they value, their abilities, and also their limitations.  It also takes into account the business goals and objectives of the group managing the project. UX best practices promote improving the quality of the user’s interaction with and perceptions of your product and any related services.”

Boxes and Arrows ( http://boxesandarrows.com/ ) – “Boxes and Arrows is devoted to the practice, innovation, and discussion of design; including graphic design, interaction design, information architecture and the design of business. Since  2001 , it’s been a peer-written journal promoting contributors who want to provoke thinking, push limits, and teach a few things along the way.”

NN Group ( http://www.nngroup.com/ ) – “NN/g conducts groundbreaking research, evaluates user interfaces, and reports real findings – not what’s popular or expected. With our approach, NN/g will help you create better experiences for real people and improve the bottom line for your business.”

PlainLanguage.gov ( http://www.plainlanguage.gov/ ) – “The Plain Language Action and Information Network (PLAIN) is a community of federal employees dedicated to the idea that citizens deserve clear communications from government. We first developed this document in the mid-90s. We continue to revise it every few years to provide updated advice on clear communication. “

Section508.gov – “Section 508 requires that Federal agencies’ electronic and information technology is accessible to people with disabilities. IT Accessibility & Workforce Division, in the U.S. General Services Administration’s Office of Governmentwide Policy, has been charged with the task of educating Federal employees and building the infrastructure necessary to support Section 508 implementation. Using this web site, Federal employees and the public can access resources for understanding and implementing the requirements of Section 508.”

Brevity - Say More with Less

Brevity - Say More with Less

Clarity (in Speech and Writing)

Clarity (in Speech and Writing)

Coherence - How to Achieve Coherence in Writing

Coherence - How to Achieve Coherence in Writing

Diction

Flow - How to Create Flow in Writing

Inclusivity - Inclusive Language

Inclusivity - Inclusive Language

Simplicity

The Elements of Style - The DNA of Powerful Writing

Unity

Recommended

Student engrossed in reading on her laptop, surrounded by a stack of books

Academic Writing – How to Write for the Academic Community

You cannot climb a mountain without a plan / John Read

Structured Revision – How to Revise Your Work

empirical research user experience

Professional Writing – How to Write for the Professional World

empirical research user experience

Credibility & Authority – How to Be Credible & Authoritative in Speech & Writing

How to Cite Sources in Academic and Professional Writing

Citation Guide – Learn How to Cite Sources in Academic and Professional Writing

Image of a colorful page with a big question in the center, "What is Page Design?"

Page Design – How to Design Messages for Maximum Impact

Suggested edits.

  • Please select the purpose of your message. * - Corrections, Typos, or Edits Technical Support/Problems using the site Advertising with Writing Commons Copyright Issues I am contacting you about something else
  • Your full name
  • Your email address *
  • Page URL needing edits *
  • Name This field is for validation purposes and should be left unchanged.

Other Topics:

Citation - Definition - Introduction to Citation in Academic & Professional Writing

Citation - Definition - Introduction to Citation in Academic & Professional Writing

  • Joseph M. Moxley

Explore the different ways to cite sources in academic and professional writing, including in-text (Parenthetical), numerical, and note citations.

Collaboration - What is the Role of Collaboration in Academic & Professional Writing?

Collaboration - What is the Role of Collaboration in Academic & Professional Writing?

Collaboration refers to the act of working with others or AI to solve problems, coauthor texts, and develop products and services. Collaboration is a highly prized workplace competency in academic...

Genre

Genre may reference a type of writing, art, or musical composition; socially-agreed upon expectations about how writers and speakers should respond to particular rhetorical situations; the cultural values; the epistemological assumptions...

Grammar

Grammar refers to the rules that inform how people and discourse communities use language (e.g., written or spoken English, body language, or visual language) to communicate. Learn about the rhetorical...

Information Literacy - Discerning Quality Information from Noise

Information Literacy - Discerning Quality Information from Noise

Information Literacy refers to the competencies associated with locating, evaluating, using, and archiving information. In order to thrive, much less survive in a global information economy — an economy where information functions as a...

Mindset

Mindset refers to a person or community’s way of feeling, thinking, and acting about a topic. The mindsets you hold, consciously or subconsciously, shape how you feel, think, and act–and...

Rhetoric: Exploring Its Definition and Impact on Modern Communication

Rhetoric: Exploring Its Definition and Impact on Modern Communication

Learn about rhetoric and rhetorical practices (e.g., rhetorical analysis, rhetorical reasoning,  rhetorical situation, and rhetorical stance) so that you can strategically manage how you compose and subsequently produce a text...

Style

Style, most simply, refers to how you say something as opposed to what you say. The style of your writing matters because audiences are unlikely to read your work or...

The Writing Process - Research on Composing

The Writing Process - Research on Composing

The writing process refers to everything you do in order to complete a writing project. Over the last six decades, researchers have studied and theorized about how writers go about...

Writing Studies

Writing Studies

Writing studies refers to an interdisciplinary community of scholars and researchers who study writing. Writing studies also refers to an academic, interdisciplinary discipline – a subject of study. Students in...

Featured Articles

Student engrossed in reading on her laptop, surrounded by a stack of books

IMAGES

  1. What Is Empirical Research? Definition, Types & Samples

    empirical research user experience

  2. Empirical Research: Definition, Methods, Types and Examples

    empirical research user experience

  3. (PDF) Empirical Research on the Metaverse User Experience of Digital

    empirical research user experience

  4. Empirical Research: Definition, Methods, Types and Examples

    empirical research user experience

  5. How to Set Up a User Research Framework (And Why Your Team Needs One

    empirical research user experience

  6. What Is Empirical Research? Definition, Types & Samples

    empirical research user experience

VIDEO

  1. Empirical Research

  2. Research Methods

  3. Undergraduate Research Experience Sharing 2021: Meeting with Undergraduate Researcher

  4. Meet the Experts: Understanding the Information-Seeking Behavior of Social Scientists

  5. Empirical research methods

  6. Week 7

COMMENTS

  1. User Experience Methods in Research and Practice

    User experience (UX) researchers in technical communication (TC) and beyond still need a clear picture of the methods used to measure and evaluate UX. ... Empirical research in technical, & professional communication: A 5-year examination of research methods and a call for research sustainability. Journal of Technical Writing and Communication ...

  2. Empirical Research on the Metaverse User Experience of Digital ...

    The metaverse has been settled as a platform that is widely beloved by digital natives that are familiar with mobile devices and immersive contents. Thanks to the protocol enabling hedonic interaction, the user experience provides significant value from its communication, enabling learning experiences anytime and anywhere. However, the research topics are focused on the promotions of ...

  3. App types, user psychological and instrumental needs, and user

    This study entails an empirical survey to analyze the influence of the satisfaction of users' psychological and instrumental needs on user experience based on the types of apps as a moderating variable. ... The instrumental value of a system in the task environment is the focus of early research on user experience, and numerous studies have ...

  4. Virtual reality as an empirical research tool

    In human-computer interaction, the term user experience has been explained as an interplay of individual perception, emotion, cognition, motivation and action, acting "in dialogue[sic!] with the world (place, time, people, and objects)" (Hassenzahl, 2010, p. 4). User experience is subjective, holistic, situated and dynamic (Hassenzahl, 2010).

  5. Full article: User experience framework that combines aspects

    Empirical studies on the commercial UX methods to assure its applicability to measuring the different UX aspects. This will help to simplify the proposed framework and give directions about which method can be used. ... "Temporal anchors in user experience research," in Proceedings of the 2014 conference on Designing interactive systems ...

  6. Mapping experience research across disciplines: who, where, when

    Human experiences have been studied in multiple disciplines, Human-Computer Interaction (HCI) being one of the largest research fields with its user experience (UX) research. Currently, there is little interaction between experience researchers from different disciplines, although cross-disciplinary knowledge sharing has the potential to accelerate the development of UX and other experience ...

  7. User Experience Methods in Research and Practice

    This paper reviews how empirical research on User Experience (UX) is conducted. It integrates products, dimensions of experience, and methodologies across a systematically selected sample of 51 ...

  8. JOURNAL OF USER EXPERIENCE Home

    Journal of User Experience (JUX) is a peer-reviewed, international, online publication dedicated to promoting and enhancing the practice, research, and education of user experience (UX) design and evaluation.The journal aims to provide UX practitioners and researchers with a forum to share:Empirical findings and case studies Emerging methods and tools from within the user experience profession ...

  9. Virtual reality as an empirical research tool

    Virtual reality as an empirical research tool — Exploring user experience in a real building and a corresponding virtual model. Author / Creator Kuliga, S.F.; Thrash, T.; Dalton, R.C.; Hölscher, C. ... The main conclusion of this article is that VR has a strong potential to be used as an empirical research tool in psychological and ...

  10. PDF User experience

    The term 'user experience' is associated with a wide variety of meanings (Forlizzi and Battarbee 2004), ranging from traditional usability to beauty, hedonic, affective or experiential aspects ...

  11. (PDF) User Experience Theories, Models, and Frameworks: A Focused

    An analytical framework was established based on a theory and some research findings (Fig. 1). User experience theory ... larger research teams, and more empirical research—especially on applied ...

  12. Sustainability

    We introduce an approach that supports researchers and practitioners to determine the quality of first-time user experience (FTUX) and long-term user experience (LTUX), as well as to identify critical issues with these two types of UX. The product we chose to study is a mobile fitness application. Mobile apps tend to have a much shorter service life than most other products; thus, the ...

  13. Virtual reality as an empirical research tool

    @article{Kuliga2015VirtualRA, title={Virtual reality as an empirical research tool - Exploring user experience in a real building and a corresponding virtual model}, author={Saskia F. Kuliga and Tyler Thrash and Ruth Conroy Dalton and Christoph H{\"o}lscher}, journal={Comput. Environ.

  14. Empirical User Study

    According to Hassenzahl et al. these both dimensions gives a clear measure on the acceptance, satisfaction, and user experience of an interactive system that goes beyond but includes usability [80, 97]. We hypothesized that the full-adaptive visualization leads to higher satisfaction and user experience [H4].

  15. Virtual reality as an empirical research tool

    In human-computer interaction, the term user experience has been explained as an interplay of individual perception, emotion, cognition, motivation and action, acting "in dialogue[sic!] with the world (place, time, people, and objects)" (Hassenzahl, 2010, p. 4). User experience is subjective, holistic, situated and dynamic (Hassenzahl, 2010).

  16. Virtual Reality as an Empirical Research Tool

    Virtual Reality as an Empirical Research Tool - Exploring User Experience in a Real Building and a Corresponding Virtual Model. / Kuliga, Saskia Felizitas; Thrash, T.; Dalton, Ruth et al. In: Computers, Environment and Urban Systems, Vol. 54, 01.11.2015, p. 363-375. Research output: Contribution to journal › Article › peer-review

  17. User experience: A concept without consensus? Exploring practitioners

    Some concepts in the field of HCI are commonly used by practitioners even if a lack of empirical research has prevented their full understanding and impact. User experience (UX) could be one of those fashion and fuzzy terms that is increasingly used even though no clear consensus has been reached yet regarding its definition or scope ...

  18. PDF Empirical Research on the Metaverse User Experience of Digital Natives

    This study intends to reveal the immersive user experience of the general metaverse platform and how the major factors of the 'Extended Real World' are implemented, the world that shows high touch on mesmeric communication beyond the user's point of view from conventional online games and cyber playgrounds. 2.2.

  19. Virtual reality as an empirical research tool

    The empirical research findings underscore the advantages of involving users early in the design process for buildings and streetscapes, leading to an enhanced user experience before implementing ...

  20. User studies in cartography: opportunities for empirical research on

    reader as the map user, and to address the perceptual, cognitive, cultural, and practical considerations that influence the user's experience with interactive maps and visualizations. In this article, we present an agenda for empirical research on this user and the interactive designs he or she employs. The research agenda is a

  21. An empirical study on user experience evaluation of VR interface in

    These empirical evidences also suggest that the established framework is effective for evaluating the user experience in VR-based digital museums. ... In the current research on cultural user experience in digital museums, there are still some research gaps. First, numerous studies have focused on evaluating the user experience of digital ...

  22. Usability and User Experience Research

    Usability is the art of making sure that any kind of communication deliverable (e.g. a website, a handbook, a user guide, etc.) is intuitive, easy-to-use , and helps users achieve their goals. Usability is part of the broader discipline known as User Experience Design (or UX), which encompasses all aspects of the look, feel, and.

  23. Empirical Research on the Metaverse User Experience of Digital Natives

    The metaverse has been settled as a platform that is widely beloved by digital natives that. are familiar with mobile devices and immersive contents. Thanks to the protocol enabling hedonic ...