Situational Judgment Test
- Introduced by
- Stephan Motowidlo, Marvin Dunnette & Gary Carter
- Year
- 1990
- Type
- Scenario-based judgment measurement procedure
- Family
- Organizational behavior / personnel selection
What does it do?
A situational judgment test (SJT) is a personnel-assessment method that presents candidates with realistic work scenarios and a set of possible responses, then measures their judgment about what action is most effective.
Stephan Motowidlo, Marvin Dunnette, and Gary Carter introduced the modern form in 1990 as a low-fidelity simulation, capturing the predictive power of work samples and assessment centers at a fraction of the cost by describing situations in writing rather than staging them. SJTs sit between abstract trait tests and full behavioral simulations, sampling the judgment that effective performance requires while remaining scalable and standardized. McDaniel, Hartman, Whetzel, and Grubb's 2007 meta-analysis established their criterion-related validity and showed that response instructions shape what they measure. Weekley and Ployhart's 2006 edited volume gave the field a comprehensive theoretical and practical treatment. SJTs are now widely used in selection across managerial, medical, and customer-facing roles.
The intuition behind the method
Knowing facts and having a high IQ does not guarantee good judgment in the messy situations that real jobs throw at people. A new manager confronted with a sulking employee, a missed deadline, and a demanding client has to decide what to actually do, and that practical judgment is what predicts success. A full simulation that puts the candidate in the room with actors would measure this well but is expensive and hard to standardize. The situational judgment test is the clever compromise: it describes the situation in a short scenario, lists several plausible things one might do, and asks the candidate which response is best, or what they would do. Because the scenarios are drawn from real critical incidents and the answers are scored against what experts or top performers consider effective, the test captures the same judgment a simulation would, but it can be printed on paper or shown on a screen and given to thousands of people at once. It trades a little realism for enormous gains in cost, consistency, and reach.
History
Scenario-based judgment testing has roots in the situational tests of the 1920s and the wartime work-sample and assessment-board traditions, but the modern SJT was crystallized by Motowidlo, Dunnette, and Carter's 1990 Journal of Applied Psychology paper introducing the low-fidelity simulation, which showed that written descriptions of situations and responses could predict performance economically. Interest grew through the 1990s as organizations sought valid, cost-effective, and less adverse-impact-prone alternatives to cognitive tests. McDaniel, Hartman, Whetzel, and Grubb's 2007 meta-analysis consolidated the validity evidence and demonstrated the decisive role of response instructions in determining what SJTs measure, while Weekley and Ployhart's 2006 edited volume provided the field's theoretical and methodological foundation. SJTs have since expanded rapidly into medical and professional admissions, multimedia and game-based formats, and global high-volume selection.
When to use it
Use a situational judgment test when you want to assess practical, job-relevant judgment at scale and a full simulation or assessment center is too costly, and when the role involves recurring interpersonal or decision-making situations that can be captured in realistic scenarios. SJTs are well suited to high-volume selection for managerial, supervisory, sales, service, and increasingly medical and educational roles, where they add validity beyond cognitive and personality tests and tend to show smaller subgroup differences than cognitive tests alone. They are less appropriate when the job's key requirements are pure technical knowledge or physical skill better measured directly, when sound scenarios and a defensible scoring key cannot be developed, or when the assessment must be entirely resistant to self-presentation, since behavioral-tendency SJTs are somewhat fakable.
Limitations and considerations
- Are construct-heterogeneous: an SJT score reflects a blend of abilities, knowledge, and personality rather than one clean trait.
- Behavioral-tendency instructions are susceptible to faking and self-presentation in high-stakes settings.
- Validity depends on scenario quality and a defensible scoring key, both labor-intensive and sometimes contested to develop.
- Scenarios can be context-specific and may not transport well across jobs, cultures, or over time as work changes.
Source conditions do not replace independent scientific review or validation by an analysis engine.
Strengths
- Capture practical, job-relevant judgment with much of a simulation's validity at a fraction of the cost and far greater scalability.
- Add incremental validity over cognitive ability and personality, improving prediction beyond standard tests.
- Tend to produce smaller subgroup differences than cognitive-ability tests, supporting fairer high-volume selection.
- Are flexible in delivery and content, adaptable to many roles and to written, video, or interactive formats.
Applications
- Screening and selecting candidates for managerial, supervisory, sales, and customer-service roles at scale.
- Assessing non-academic attributes such as professionalism and teamwork in medical, nursing, and graduate admissions.
- Adding incremental validity to selection batteries alongside cognitive-ability and personality measures.
- Measuring job-specific practical judgment and tacit knowledge that abstract tests miss.
- Supporting fairer selection by complementing cognitive tests with assessments that show smaller subgroup differences.
How it works
How it works
Development begins by generating realistic work scenarios, usually mined from critical incidents collected from job experts who describe situations in which behavior made a clear difference to performance. Motowidlo, Dunnette, and Carter built their low-fidelity simulation from exactly such incidents, so that each scenario poses a genuine dilemma the job presents rather than an artificial puzzle. The quality of these scenarios is foundational: they must be job-relevant, realistic, and capable of discriminating good judgment from poor judgment, because a test built on contrived or trivial situations cannot measure the practical judgment it aims to assess.
Formula
S = \{s_1,\dots,s_n\} \text{ from critical incidents};\quad s_k = \text{realistic work dilemma}For each scenario, a set of plausible response options is written, representing different courses of action that vary in effectiveness. The options are typically generated from how real respondents and experts say they would handle the situation, ensuring that even the poorer options are realistic temptations rather than obviously wrong choices. Motowidlo and colleagues emphasize that the discriminating power of the test depends on these options spanning a meaningful range of effectiveness; if every option is clearly good or clearly bad, candidates cannot reveal the subtle judgment the test is designed to capture.
Formula
s_k \to \{o_{k1},\dots,o_{km}\},\quad \text{plausible actions of varying effectiveness}A pivotal design decision is the response instruction, which determines what the test asks candidates to do with the options. Knowledge instructions ask what one should do or which option is best or worst, eliciting a candidate's understanding of effective action; behavioral-tendency instructions ask what one would most and least likely do, eliciting self-reported behavioral inclination. McDaniel, Hartman, Whetzel, and Grubb showed this choice matters substantially: knowledge-type instructions correlate more with cognitive ability, while behavioral-tendency instructions correlate more with personality, so the instruction shapes the very constructs the SJT measures.
Formula
\text{behavioral tendency } (\text{would do}) \;\mid\; \text{knowledge} (\text{should do})A scoring key is then constructed that assigns values to the response options, defining which choices are credited and how much. Keys are built rationally from subject-matter-expert consensus on option effectiveness, empirically by relating options to a performance criterion, or by a hybrid of the two. As the Weekley and Ployhart volume documents, keying is a consequential and sometimes contested step, since different keying methods can change scores and validity, and the legitimacy of the key, its grounding in genuine expertise or sound empirical evidence, underwrites the meaning of the resulting scores.
Formula
w_{kj} = \text{value of option } o_{kj} \text{ from SME consensus or empirical keying}Finally, candidates' responses are scored against the key and the test is validated against performance outcomes. McDaniel and colleagues' meta-analysis established that SJTs predict job performance with useful validity and, importantly, add incremental validity beyond cognitive ability and the Big Five personality traits, justifying their inclusion in selection batteries. This validation step confirms that the practical judgment the test captures translates into job behavior, and ongoing analysis of subgroup differences, fakability, and construct saturation refines how SJT scores should be interpreted and used.
Formula
\text{score}_i = \sum_k w_{k, c_{ik}};\quad \rho_{\text{SJT,perf}} \approx 0.20\text{--}0.34,\ \Delta R^2 > 0Common pitfalls
- Ignoring the response-instruction choice and then being surprised that the test correlates with ability or personality differently than expected.
- Building a scoring key from weak or non-representative experts, undermining the meaning of every score.
- Writing implausible distractor options so that good judgment is too easy to display.
- Treating an SJT as a measure of a single construct when its score is inherently multidimensional.
Frequently asked questions
What does a situational judgment test actually measure?
An SJT measures practical judgment about how to act effectively in work situations, but it is construct-heterogeneous rather than a measure of a single trait. McDaniel, Hartman, Whetzel, and Grubb showed that what it taps depends heavily on the response instruction: knowledge instructions, asking what one should do, correlate more with cognitive ability, while behavioral-tendency instructions, asking what one would do, correlate more with personality traits such as conscientiousness and agreeableness. In practice an SJT score blends ability, job knowledge, and dispositional tendencies, which is part of why it predicts performance incrementally over any one of those measures alone, but it also means SJT scores should not be interpreted as pure indicators of a single construct.
How are situational judgment tests scored?
Responses are compared to a scoring key that assigns values to the options. Keys are developed rationally, by having subject-matter experts rate the effectiveness of each option and credit choices accordingly; empirically, by relating options to an external performance criterion and keying those that distinguish high from low performers; or by combining both. As the Weekley and Ployhart volume discusses, the keying method is consequential because different approaches can yield different scores and validities, and the credibility of the experts or the quality of the criterion data directly determines how meaningful the scores are. Transparent, well-justified keying is therefore central to a defensible SJT.
Can candidates fake a situational judgment test?
To a degree, and it depends on the response instruction. Behavioral-tendency SJTs, which ask what a candidate would do, are more susceptible to faking because respondents can report what they think the employer wants rather than their genuine inclination, especially in high-stakes selection. Knowledge-based SJTs, which ask what should be done, are harder to fake because there are more and less correct answers, though they shade toward measuring ability. Research suggests faking inflates scores somewhat but does not eliminate validity. Designers manage this by choosing instructions deliberately, using less transparent keys, and combining SJTs with other measures rather than relying on them alone.
Related methods
Sources
Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75(6), 640-647.
Open DOI referenceCopied.McDaniel, M. A., Hartman, N. S., Whetzel, D. L., & Grubb, W. L. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60(1), 63-91.
Open DOI referenceCopied.Weekley, J. A., & Ployhart, R. E. (Eds.). (2006). Situational Judgment Tests: Theory, Measurement, and Application. Lawrence Erlbaum Associates.
ISBN: 9780805852516Copied.