Experimental Comparisons of Usability Evaluation Methods
A Special Issue of Human-Computer Interaction
1st Edition
Published on 28. October 2021
144 pages
978-1-000-11088-3 (ISBN)
Description
This special issue contains essays regarding the CHI '95 conference, which featured a panel titled, Discount or Disservice? Discount Usability Analysis: Evaluation at a Bargain Price or Simply Damaged Merchandise? Wayne Gray, who organized the panel, presented a controversial critique of studies that had evaluated various usability evaluation methods (UEMs). The level of interest in this discussion led Gray to propose a review article that dealt with the issues in a more systematic fashion. The resulting essay, written by Gray and his collaborator Marilyn Salzman, conducted an in-depth review of a series of influential studies that used experimental methods to compare a variety of UEMs. Gray and Salzman's analysis was framed using Cook and Campbell's (1979) well-known discussion of various forms of validity. They used this to evaluate numerous details of these comparative studies, and they concluded that the studies fell short on the criteria by which good experimental studies are designed and interpreted.
More details
Edition
1. Auflage
Language
English
Place of publication
London
United Kingdom
Publishing group
Taylor & Francis Ltd
Target group
Professional and scholarly
ISBN-13
978-1-000-11088-3 (9781000110883)
Copyright in bibliographic data and cover images is held by Nielsen Book Services Limited or by the publishers or by their respective licensors: all rights reserved.
Schweitzer Classification
Other editions
Additional editions
Gary A. Olson
Experimental Comparisons of Usability Evaluation Methods
A Special Issue of Human-Computer Interaction
Book
12/2020
1st Edition
CRC Press
€274.84
Shipment within 10-20 days
Gary A. Olson
Experimental Comparisons of Usability Evaluation Methods
A Special Issue of Human-Computer Interaction
Book
12/1998
1st Edition
CRC Press
€59.60
Shipment within 10-20 days
Person
University of Michigan. Xerox Palo Alto Research Center.
Content
1. OVERVIEW -- 2. INTRODUCTION -- 3. THE UNIQUE ROLE AND BURDEN OF EXPERIMENTS IN EMPIRICAL STUDIES OF HUMAN-COMPUTER INTERACTION -- 4. THREATS TO THE VALIDITY OF EXPERIMENTAL STUDIES -- 4.1. Cause-Effect Issues -- Statistical Conclusion Validity -- Internal Validity -- 4.2. Generality Issues -- Construct Validity -- External Validity -- 4.3. Conclusion Validity -- 4.4. Summary: Threats to Validity of Experimental Studies -- 5. THREATS TO THE VALIDITY OF FIVE INFLUENTIAL UEM STUDIES -- 5.1. Jeffries, Miller, Wharton, and Uyeda (1991) -- Overview -- Statistical Conclusion Validity -- Internal Validity -- Construct Validity -- External Validity -- Conclusion Validity -- Summary of the Review of Jeffries et al. (1991) -- 5.2. Karat, Campbell, and Fiegel (1992) -- Overview -- Statistical Conclusion Validity -- Internal Validity -- Construct Validity -- External Validity -- Conclusion Validity -- Summary of the Review of Karat et al. (1992) -- 5.3. Nielsen (1992) -- Overview -- Evaluation -- Statistical Conclusion Validity -- Internal Validity -- Construct Validity -- Conclusion Validity -- Summary of the Review of Nielsen ( 1992) -- 5.4. Desurvire, Kondziela, and Atwood (1992) -- Overview -- Statistical Conclusion Validity: Sample Size -- Internal Validity: Selection -- Construct Validity and External Validity -- Summary of the Review of Desurvire et al. ( 1992) -- 5.5. Nielsen and Phillips (1993) -- Overview -- Statistical Conclusion Validity -- Internal Validity -- Construct Validity and External Validity -- Conclusion Validity -- Summary of the Review of Nielsen and Phillips (1993) -- 5.6. Summary of the Reviews -- 6. OBSERVATIONS AND RECOMMENDATIONS -- 6.1. Predicting and Measuring Usability: Effect Construct Validity -- Hits, False Alarms, Misses, and Correct Rejections -- Tokens, Types, and Categories of Usability Problems -- Convergent Measures -- Effect Construct Validity: Recommendations -- 6.2. Recommendations for Addressing the Four Types of Validity -- Statistical Conclusion Validity -- Internal Validity -- Causal Construct Validity -- External Validity -- Conclusion Validity -- 6.3. Summary of Observations and Recommendations -- 7. CONCLUSIONS -- APPENDIX: VALIDITY OF CLAIMS MADE BY THE STUDIES REVIEWED.
