Competency-based Exam Development Process: Lessons Learned in the Professional Pilot Domain

The global pilot shortage that has grown with each new 20-year projection since 2009 poses both safety and economic risks for the aviation industry, particularly in emerging economies. While most industry conversations focus... [ view full abstract ]

The global pilot shortage that has grown with each new 20-year projection since 2009 poses both safety and economic risks for the aviation industry, particularly in emerging economies. While most industry conversations focus exclusively on the quantity of pilots needed, this research evaluates a potentially better way to determine the quality of pilots entering this career field. Regulatory and industry leaders agree that many traditional knowledge exams now in-use are outdated and ineffective for the technical and operational complexity of today’s operational environment. This paper focuses on the lessons learned in developing and fielding the prototype of a competency-based knowledge examination for professional pilots that would (a) assess relevant knowledge possessed by entry-level professional pilots across a broad cross-section of countries, (b) provide secure and reliable administration of the examination, and (c) categorize the candidates’ performance as either (i) below Commercial/Instrument Rating standards, (ii) meets the Commercial/IR standards but below industry standards, (iii) meets the industry standards, (iv) meets the industry’s mastery-level standards. The results of this research could be used to scale up the prototype and develop a globally-acceptable professional pilot knowledge exam in the future, generating a wide range of high-value safety and operational benefits for employers, trainers, pilots, regulatory authorities and other industry stakeholders around the world.