Job Task Analysis & Exam Weights

Rationale and Overview

With the goal of developing and implementing a certification exam, the Association for Applied Sport Psychology (AASP) conducted a Job Task Analysis (JTA) to identify the domains of practice, tasks performed, and knowledge required for effective performance as a professional in applied sport psychology.  The practice analysis document establishes the specifications to be used for the item writing and examination construction phases of the development of the AASP certification examination.

After extensive advertising to identify possible Subject Matter Experts (SMEs), a selection committee reviewed 61 nominations and chose a 13-member SME group based upon professional and demographic information related to Gender, Geography, Practice Setting, Level of Practice, Training Background, Diversity, and Type of Practice.  Specifically, the purpose of this meeting was to:

1)   Produce a document delineating the knowledge required for the competent and effective performance of the tasks carried out by the certification-level professionals in sport psychology.

2)   Identify weighting factors for examination development based on the pooled judgments of the SMEs of the relative importance and frequency of performance of the major practice areas.

3)   Produce a list of performance domains, and associated tasks and knowledge statements to be used as the basis for examination item (question) writing and test construction.

Developing the Draft Test Specifications

The JTA procedure (i.e., “role delineation”) involved a number of steps including:

1)   Identification of competency or performance domains.

2)   Preparation of task statements.

3)   Identification of necessary knowledge.

4)   Development of domain weights.

5)   Validation of task, knowledge statements and weights.

6)   Preparation of final test specifications.

Six domains were identified by the SMEs: 1) Rapport, Roles and Expectations, 2) Assessment, 3) Goals, Outcomes and Planning, 4) Implementation, 5) Evaluation, and 6) Professional Issues.

Job Task Analysis Validation

The validation process consisted of an on-line survey of currently certified practitioners (CC-AASP N=403).  Of those surveyed, respondents (n=103; 25.6%) appeared to be diverse in terms of the professional and demographic variables considered during selection of the SMEs.

Comments received from this survey did not result in any changes to the identified Domains.  However, evaluation of survey comments did result in modifications being made to several task (n=8 changed) and knowledge statements (n=2 changed, and n=2 added).  Slight modifications were also made to the domain weights (n=2).

The final JTA document includes 6 domains, 21 tasks, and 38 knowledge statements.

Weighted Exam Content Outline

DOMAIN PROPOSED FINAL WEIGHTS
Domain I - Rapport, Roles and Expectations 13%
Domain II – Assessment 16%
Domain III – Goals, Outcomes and Planning 20%
Domain IV – Implementation 35%
Domain V – Evaluation 11%
Domain VI – Professional Issues 5%
TOTAL 100%


Please click here to access the full Job Task Analysis and draft test specifications

Follow Us:

social-btm social-btm social-btm