Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Understanding Variance in Pilot Performance Ratings: Two Studies of Flight Examiners, Captains, and First Officers Assessing the Performance ofPeers

Understanding Variance in Pilot Performance Ratings: Two Studies of Flight Examiners, Captains,... Two studies were designed to investigate how pilots of different rank evaluate flight-deckperformance. In each study, the pilots were asked to assess sets of three different videotapedscenarios featuring pilots in a simulator exhibiting poor, average, and good performance. Study 1,which included 92 airline pilots of differing rank, was aimed at comparing how individuals rateperformance. The subjects used a standardized assessment form, which included six criteria, eachhaving a 5-point rating scale. Analysis of the first study revealed that there was considerablevariance in the performance ratings between flight examiners, captains, and first officers. Thesecond study was designed to better understand the variance. Eighteen pilots (six flight examiners,six captains, and six first officers) working in pairs evaluated performances, in a modifiedthink-aloud protocol. The results showed that there were good reasons for the observed variances.The results are discussed in relation to inter-rater reliability. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Aviation Psychology and Applied Human Factors American Psychological Association

Understanding Variance in Pilot Performance Ratings: Two Studies of Flight Examiners, Captains, and First Officers Assessing the Performance ofPeers

Loading next page...
 
/lp/american-psychological-association/understanding-variance-in-pilot-performance-ratings-two-studies-of-vnxegsoyIw
Publisher
American Psychological Association
Copyright
Copyright © 2013 Hogrefe Publishing
ISSN
2192-0923
eISSN
2192-0931
DOI
10.1027/2192-0923/a000041
Publisher site
See Article on Publisher Site

Abstract

Two studies were designed to investigate how pilots of different rank evaluate flight-deckperformance. In each study, the pilots were asked to assess sets of three different videotapedscenarios featuring pilots in a simulator exhibiting poor, average, and good performance. Study 1,which included 92 airline pilots of differing rank, was aimed at comparing how individuals rateperformance. The subjects used a standardized assessment form, which included six criteria, eachhaving a 5-point rating scale. Analysis of the first study revealed that there was considerablevariance in the performance ratings between flight examiners, captains, and first officers. Thesecond study was designed to better understand the variance. Eighteen pilots (six flight examiners,six captains, and six first officers) working in pairs evaluated performances, in a modifiedthink-aloud protocol. The results showed that there were good reasons for the observed variances.The results are discussed in relation to inter-rater reliability.

Journal

Aviation Psychology and Applied Human FactorsAmerican Psychological Association

Published: Nov 29, 2013

There are no references for this article.