The Situated Nature of Validity: Exploring Cultural Dependency in Clinical Teacher Evaluation in Japan—Implications for Global Scholarship

{"Validity":[0],"research":[1],"on":[2,14,40],"clinical":[3,48,99,366],"teacher":[4,118,326],"evaluations":[5],"predominantly":[6],"reflects":[7],"Western":[8,196],"perspectives.":[9],"This":[10,31],"obscures":[11],"cultural":[12,154,399],"influences":[13],"this":[15,153,375],"phenomenon":[16],"in":[17,50,190,275,348,397],"non-Western":[18,250],"settings,":[19,103],"where":[20,252,379],"insufficient":[21],"evidence":[22],"may":[23,116,247],"lead":[24],"to":[25,36,110,192,261,273,317,331],"incomplete":[26],"or":[27,184],"biased":[28],"validity":[29,208],"interpretations.":[30,288],"article":[32],"integrates":[33],"four":[34],"studies":[35],"explore":[37],"culture's":[38],"influence":[39],"instrument":[41,60],"design":[42,61],"and":[43,57,80,149,221,256,280,308,394],"rater":[44,122],"sense-making":[45,123,227],"for":[46,83,266,284,321,325,364],"evaluating":[47],"teachers":[49],"Japan-a":[51],"context":[52],"characterized":[53],"by":[54],"Confucian":[55],"hierarchy":[56],"collectivism.":[58],"For":[59],"(Studies":[62],"1-3),":[63],"we":[64,311],"used":[65],"a":[66,107,160,180,185,210,237,267,282,342,361,370],"rigorous":[67],"multi-step":[68],"approach":[69],"involving":[70,144],"item":[71],"generation":[72],"through":[73,138,295],"interviews,":[74],"content":[75],"validation":[76],"via":[77],"expert":[78],"panels,":[79],"factor":[81],"analysis":[82],"construct":[84,213],"validation.":[85],"Findings":[86],"suggest":[87],"that":[88,115,134,169,207,225,241],"stakeholders":[89],"prioritized":[90],"\\"accessibility\\"":[91],"(ease":[92],"of":[93,98,141,159,187,198,302,338],"consultation)":[94],"over":[95],"Western-centric":[96],"notions":[97],"competence.":[100],"In":[101],"hierarchical":[102],"accessibility":[104],"serves":[105],"as":[106,164,259,298],"\\"structural":[108],"prerequisite\\"":[109],"mitigate":[111],"\\"socially":[112],"risky\\"":[113],"questioning":[114],"expose":[117],"inadequacy.":[119],"To":[120],"understand":[121],"(Study":[124],"4),":[125],"constructivist":[126],"grounded":[127],"theory":[128],"methodology":[129],"using":[130],"semi-structured":[131],"interviews":[132],"demonstrated":[133],"residents":[135],"perceive":[136],"evaluation":[137,158,174,291,327],"moral":[139],"recognition":[140],"reciprocal":[142],"duties":[143],"Li":[145],"(propriety),":[146],"Ren":[147,382],"(benevolence),":[148],"Yi":[150],"(righteousness).":[151],"Within":[152],"operating":[155],"system,":[156],"critical":[157],"superior":[161],"is":[162,209,228,383],"perceived":[163],"an":[165],"\\"unnatural":[166],"social":[167,171,182,212,239,336],"act\\"":[168],"disrupts":[170],"order.":[172],"Consequently,":[173],"transforms":[175],"from":[176,215,270,328],"objective":[177,199,234],"measurement":[178,201,235],"into":[179,236,360],"\\"situated":[181,238],"negotiation\\"":[183,240],"\\"gift":[186],"gratitude\\"":[188],"offered":[189],"response":[191],"received":[193],"obligations,":[194],"making":[195],"ideals":[197],"quality":[200],"theoretically":[202],"implausible.":[203],"Our":[204],"inquiry":[205],"demonstrates":[206],"\\"situated\\"":[211],"arising":[214],"the":[216,243,303,335,349,380,386],"interaction":[217],"between":[218],"tool,":[219],"evaluator,":[220],"context.":[222],"We":[223,264],"conclude":[224],"local":[226,293],"paramount;":[229],"ignoring":[230],"it":[231],"risks":[232],"transforming":[233],"invalidates":[242],"results.":[244],"These":[245],"findings":[246],"resonate":[248],"across":[249],"Asia,":[251],"high":[253],"power":[254],"distance":[255],"collectivism":[257],"act":[258],"barriers":[260],"feedback":[262,359],"practices.":[263],"advocate":[265],"paradigm":[268],"shift":[269],"mere":[271],"translation":[272],"\\"transculturation\\"":[274],"global":[276],"health":[277],"professions":[278],"education":[279],"provide":[281],"framework":[283],"examining":[285],"culturally":[286],"situated":[287],"By":[289],"aligning":[290],"with":[292,385],"values":[294],"models":[296],"such":[297],"collective":[299,365],"competency":[300],"(evaluation":[301],"teaching":[304,332],"team),":[305],"teacher-led":[306],"inquiry,":[307],"multi-source":[309],"feedback,":[310],"ensure":[312],"assessments":[313],"transcend":[314],"perfunctory":[315],"rituals":[316],"become":[318],"meaningful":[319],"catalysts":[320],"dialogue.":[322],"Shifting":[323],"responsibility":[324,363],"individual":[329],"dyads":[330],"teams":[333],"mitigates":[334],"risk":[337],"direct":[339],"criticism":[340],"toward":[341],"specific":[343],"superior,":[344],"thereby":[345],"enabling":[346],"improvements":[347],"educational":[350],"environment":[351],"while":[352],"maintaining":[353],"psychological":[354],"safety.":[355],"Such":[356],"approaches":[357],"transform":[358],"shared":[362],"safety":[367],"rather":[368],"than":[369],"one-way":[371],"subordinate-led":[372],"judgment.":[373],"Ultimately,":[374],"promotes":[376],"\\"quality":[377],"culture\\"":[378],"teacher's":[381],"met":[384],"resident's":[387],"reflective":[388],"engagement,":[389],"ensuring":[390],"authentic":[391],"faculty":[392],"development":[393],"patient":[395],"care":[396],"diverse":[398],"landscapes.":[400]}

Authors

Institutions

Publication Details

Journal
Teaching and Learning in Medicine
Published
2026-09-16
DOI
https://doi.org/10.1080/10401334.2026.2731021
Primary Topic
Evaluation and Performance Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

The Situated Nature of Validity: Exploring Cultural Dependency in Clinical Teacher Evaluation in Japan—Implications for Global Scholarship

Renée E. Stalmeijer, Makoto Kikukawa, Lambert Schuwirth, Niiro Hiroaki et al.
Teaching and Learning in Medicine
Evaluation and Performance Assessment
article

The Situated Nature of Validity: Exploring Cultural Dependency in Clinical Teacher Evaluation in Japan—Implications for Global Scholarship

Renée E. Stalmeijer, Makoto Kikukawa, Lambert Schuwirth, Niiro Hiroaki, Albert J.J.A Scherpbier
article en

Abstract

Validity research on clinical teacher evaluations predominantly reflects Western perspectives. This obscures cultural influences on this phenomenon in non-Western settings, where insufficient evidence may lead to incomplete or biased validity interpretations. This article integrates four studies to explore culture's influence on instrument design and rater sense-making for evaluating clinical teachers in Japan-a context characterized by Confucian hierarchy and collectivism. For instrument design (Studies 1-3), we used a rigorous multi-step approach involving item generation through interviews, content validation via expert panels, and factor analysis for construct validation. Findings suggest that stakeholders prioritized "accessibility" (ease of consultation) over Western-centric notions of clinical competence. In hierarchical settings, accessibility serves as a "structural prerequisite" to mitigate "socially risky" questioning that may expose teacher inadequacy. To understand rater sense-making (Study 4), constructivist grounded theory methodology using semi-structured interviews demonstrated that residents perceive evaluation through moral recognition of reciprocal duties involving Li (propriety), Ren (benevolence), and Yi (righteousness). Within this cultural operating system, critical evaluation of a superior is perceived as an "unnatural social act" that disrupts social order. Consequently, evaluation transforms from objective measurement into a "situated social negotiation" or a "gift of gratitude" offered in response to received obligations, making Western ideals of objective quality measurement theoretically implausible. Our inquiry demonstrates that validity is a "situated" social construct arising from the interaction between tool, evaluator, and context. We conclude that local sense-making is paramount; ignoring it risks transforming objective measurement into a "situated social negotiation" that invalidates the results. These findings may resonate across non-Western Asia, where high power distance and collectivism act as barriers to feedback practices. We advocate for a paradigm shift from mere translation to "transculturation" in global health professions education and provide a framework for examining culturally situated interpretations. By aligning evaluation with local values through models such as collective competency (evaluation of the teaching team), teacher-led inquiry, and multi-source feedback, we ensure assessments transcend perfunctory rituals to become meaningful catalysts for dialogue. Shifting responsibility for teacher evaluation from individual dyads to teaching teams mitigates the social risk of direct criticism toward a specific superior, thereby enabling improvements in the educational environment while maintaining psychological safety. Such approaches transform feedback into a shared responsibility for collective clinical safety rather than a one-way subordinate-led judgment. Ultimately, this promotes "quality culture" where the teacher's Ren is met with the resident's reflective engagement, ensuring authentic faculty development and patient care in diverse cultural landscapes.

Teaching and Learning in Medicine
NSW Department of Education (AU), Kyushu University (JP), Maastricht University (NL), Department of Health (TW), Department of Education (ES)
Openalex Percentile: Top 7%
Evaluation and Performance Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.