The Experience Gap: Better Appraisals for Clinical XR
Formative evaluation is a vital pillar of implementation science, used to identify early barriers to adoption before deploying new health technologies. Traditionally, this process relies on gathering stakeholders’ expectations through preuse questionnaires. While this works well for standard screen-based apps, it hits a bottleneck when applied to immersive systems like Extended Reality (XR).
Key Takeaways |
|
Misinterpretation of Feedback: Traditional preuse questionnaires for clinical XR often produce inaccurate results because most clinicians are XR-naive, leading them to provide feedback based on pure anticipation rather than direct usage. |
| The Proposed Solution: The authors recommend experiential familiarization, a brief 10- to 20-minute hands-on session, before administering surveys to ensure stakeholder perceptions are anchored in real experience. |
| Preventing Pilot Abandonment: By grounding evaluations in actual exposure, health systems can avoid prematurely abandoning promising XR projects due to misinterpreting user uncertainty as fixed structural barriers. |
In a recent viewpoint article published in JMIR Formative Research, José Ferrer Costa and Manuel Armayones Ruiz examine this methodological misalignment, introducing a concept called the experience gap and offering a practical solution for technology adoption.
What Is the Experience Gap?
When evaluating traditional digital tools, clinicians draw upon a lifetime of experience with smartphones or computers. However, large segments of the healthcare workforce remain entirely XR-naive; surveys show only 5% of clinicians in public hospitals have used virtual reality in care.
Without direct exposure to head-mounted displays, stakeholders answering early surveys must rely on pure anticipation. This lack of a reference point creates an experience gap, where simple uncertainty about physical comfort, safety, or usability is frequently misclassified as a fixed structural barrier to adoption. This can cause health systems to abandon promising pilot initiatives entirely because of artifacts in how the initial survey was timed.
The Solution: Experiential Familiarization
To bridge this gap, the authors propose a low-burden preparatory modification to standard workflows: incorporating brief experiential familiarization before collecting stakeholder perceptions.
Rather than executing a resource-intensive pilot deployment, organizations can run structured encounters lasting just 10 to 20 minutes:
- Operational Handling: 5 minutes
Provide a baseline physical overview where participants handle the headset hardware and see the interface projected on an external screen. - First-Person Immersive Use: 10 minutes
Guide the stakeholder through a short first-person virtual experience, using the exact application under consideration for routine practice. - Immediate Post-Exposure Appraisal: 5 minutes
Administer standard implementation surveys to capture perceptions of safety, comfort, and relevance now that they are anchored in real experience.
| In this video, José Ferrer Costa from Badalona Serveis Assistencials, the Jordi Gol Primary Care Research Institute (IDIAP Jordi Gol), and the Behavioural Design Lab at Universitat Oberta de Catalunya (UOC) examines a methodological mismatch in implementation science when predicting how healthcare workforces will adopt Extended Reality (XR) systems. |
Why JMIR?
The authors chose JMIR Formative Research to share these insights due to the journal's focus on the intersection of digital health and professional practice. As healthcare systems globally undergo digital transformations, this analysis provides a clear methodological guideline to ensure early-stage evaluations yield accurate, actionable data for technology integration.
Curious to see how experiential exposure is reshaping the future of healthcare technology integration? Watch the video featuring José Ferrer Costa and read the full viewpoint article to explore the experience-informed framework and the strategic roadmap for responsible XR adoption.
Ferrer Costa J, Armayones Ruiz M
Enhancing the Predictive Value of Formative Evaluation in Extended Reality Adoption: Addressing the Experience Gap
JMIR Form Res 2026;10:e93029
URL: https://formative.jmir.org/2026/1/e93029
DOI: 10.2196/93029
