Mixed methods instrument validation: Evaluation procedures for practitioners developed from the validation of the Swiss Instrument for Evaluating Interprofessional Collaboration

Grand-Guillaume-Perrenoud, Jean Anthony; Geese, Franziska; Uhlmann, Katja; Blasimann Schwarz, Angela; Wagner, Felicitas L.; Neubauer, Florian B.; Huwendiek, Sören; Hahn, Sabine; Schmitt, Kai-Uwe (2023). Mixed methods instrument validation: Evaluation procedures for practitioners developed from the validation of the Swiss Instrument for Evaluating Interprofessional Collaboration BMC Health Services Research, 23(83), pp. 1-22. BioMed Central Springer Nature 10.1186/s12913-023-09040-3

[img]
Preview
Text
Grand-Guillaume-Perrenoud et al_2023_Mixed methods instrument validation.pdf - Published Version
Available under License Creative Commons: Attribution (CC-BY).

Download (1MB) | Preview

Background Quantitative and qualitative procedures are necessary components of instrument development and assessment. However, validation studies conventionally emphasise quantitative assessments while neglecting qualitative procedures. Applying both methods in a mixed methods design provides additional insights into instrument quality and more rigorous validity evidence. Drawing from an extensive review of the methodological and applied validation literature on mixed methods, we showcase our use of mixed methods for validation which applied the quality criteria of congruence, convergence, and credibility on data collected with an instrument measuring interpro‐ fessional collaboration in the context of Swiss healthcare, named the Swiss Instrument for Evaluating Interprofessional Collaboration. Methods We employ a convergent parallel mixed methods design to analyse quantitative and qualitative question‐ naire data. Data were collected from staff, supervisors, and patients of a university hospital and regional hospitals in the German and Italian speaking regions of Switzerland. We compare quantitative ratings and qualitative comments to evaluate the quality criteria of congruence, convergence, and credibility, which together form part of an instru‐ ment’s construct validity evidence. Results Questionnaires from 435 staff, 133 supervisors, and 189 patients were collected. Analysis of congruence potentially provides explanations why respondents’ comments are off topic. Convergence between quantitative ratings and qualitative comments can be interpreted as an indication of convergent validity. Credibility provides a summary evaluation of instrument quality. These quality criteria provide evidence that questions were understood as intended, provide construct validity, and also point to potential item quality issues. Conclusions Mixed methods provide alternative means of collecting construct validity evidence. Our suggested procedures can be easily applied on empirical data and allow the congruence, convergence, and credibility of questionnaire items to be evaluated. The described procedures provide an efficient means of enhancing the rigor of an instrument and can be used alone or in conjunction with traditional quantitative psychometric approaches.

Item Type:

Journal Article (Original Article)

Division/Institute:

School of Health Professions
School of Health Professions > Midwifery
School of Health Professions > Academic-Practice-Partnership Insel Gruppe/BFH

Name:

Grand-Guillaume-Perrenoud, Jean Anthony0000-0003-0543-2454;
Geese, Franziska0000-0002-4398-3575;
Uhlmann, Katja;
Blasimann Schwarz, Angela0000-0003-0934-8284;
Wagner, Felicitas L.;
Neubauer, Florian B.;
Huwendiek, Sören;
Hahn, Sabine0000-0002-2697-2014 and
Schmitt, Kai-Uwe0000-0003-3439-9323

Subjects:

H Social Sciences > H Social Sciences (General)
R Medicine > R Medicine (General)
R Medicine > RZ Other systems of medicine

ISSN:

1472-6963

Publisher:

BioMed Central Springer Nature

Language:

English

Submitter:

Jean Anthony Grand-Guillaume-Perrenoud

Date Deposited:

30 Jan 2023 14:31

Last Modified:

30 Jan 2023 14:31

Publisher DOI:

10.1186/s12913-023-09040-3

Uncontrolled Keywords:

Validation study, Surveys and questionnaires, Mixed methods, Interprofessional collaboration, Healthcare delivery

ARBOR DOI:

10.24451/arbor.18792

URI:

https://arbor.bfh.ch/id/eprint/18792

Actions (login required)

View Item View Item
Provide Feedback