Training and validation of standardized patients for evaluation of general practitioners' performance in management of obesity and overweight

Changiz, Tahereh; Jamshidian, Sepideh; Entezari, Mohamad Hassan; Kassaian, Nazila

Training and validation of standardized patients for evaluation of general practitioners' performance in management of obesity and overweight

Authors

¹ Department of Medical Education, Medical Education Research Center, Isfahan University of Medical Sciences, Isfahan, Iran

² Department of Clinical Nutrition, School of Nutrition and Food Sciences, Food Security Research Center, Isfahan University of Medical Sciences, Isfahan, Iran

³ Department of Medical Education, School of Medical Education, Shahid Beheshti University of Medical Sciences, Tehran, Iran

Abstract

Background: Standardized patient (SP) can serve as a valuable tool to measure the physician performance in actual clinical settings, but it has not been validated for obesity/overweight disorders. This study has been conducted to describe the process of creating reliable and valid SPs for evaluation of general-practitioners' management of obesity/overweight in Iran.
Materials and Methods: A total of 6 obese/overweight volunteers (potential SPs) took part in training. Three scenarios, along with corresponding checklists including 102 items representing different aspects of diagnosis and treatment of obesity/overweight, were developed by an expert group. The SPs were trained using role playing method. During this part, one of the SPs failed. The SPs' portrayal of their respective scenario was online watched in another room and the checklist filled independently by the physician, research assistant and other SPs. The reliability of the checklist to be used by the SPs was assessed by Cronbach's alpha. The overall inter-rater agreement was calculated by the intraclass correlation coefficient statistic for total scores.
Results: The 5 eligible SPs were all women between 20 years and 39 years of age. Inter-rater agreement between the SPs' total scores was 0.899, value (95% confidence intervals) were 11.8 (0.68-0.98) and P value was <0.001. The Cronbach's alpha for reliability of completed checklists was 0.91.
Conclusion: SP could be a powerful instrument for evaluating medical performance of general practitioners in the field of obesity/overweight management. Further research is needed to find the more aspects of training and validation of unannounced SPs in this field.

Keywords

References

1.	Mokdad AH, Ford ES, Bowman BA, Dietz WH, Vinicor F, Bales VS, et al. Prevalence of obesity, diabetes, and obesity-related health risk factors, 2001. JAMA 2003;289:76-9.
2.	Akhavan A, Kelishadi R, Sadri GH, Sabet B, Toloui R, Baghai AH. Prevalence of obesity in central part of Iran: Healthy heart project. J Gazvin Univ Med Sci 2003;26:27-35.
3.	Martin PD, Dutton GR, Rhode PC, Horswell RL, Ryan DH, Brantley PJ. Weight loss maintenance following a primary care intervention for low-income minority women. Obesity (Silver Spring) 2008;16:2462-7.
4.	Potter MB, Vu JD, Croughan-Minihane M. Weight management: What patients want from their primary care physicians. J Fam Pract 2001;50:513-8.
5.	Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: A prospective validation study of 3 methods for measuring quality. JAMA 2000;283:1715-22.
6.	Fihn SD. The quest to quantify quality. JAMA 2000;283:1740-2.
7.	Tamblyn RM. Use of standardized patients in the assessment of medical practice. Can Med Assoc J 1998;158:205-7.
8.	Shirazi M, Sadeghi M, Emami A, Kashani AS, Parikh S, Alaeddini F, et al. Training and validation of standardized patients for unannounced assessment of physicians' management of depression. Acad Psychiatry 2011;35:382-7.
9.	National Institutes of Health. Clinical Guidelines on the Identification Evaluation and Treatment of Overweight and Obesity in Adults. New York (USA): NIH Publication; 1998.
10.	Scottish Intercollegiate Guidelines Network. Management of Obesity: A National Clinical Guideline, 2010. Available from: http://www.sign.ac.uk./guidelines/index.html [Last accessed on 2012 Feb 25].
11.	Health Team Works. Adults Obesity Guideline: Weight Assessment and Management Algorithm, 2011. Available from: http://www.healthteamworks.org/guidelines/obesity.html [Last accessed on 2012 Feb 24].
12.	Rethans JJ, Gorter S, Bokken L, Morrison L. Unannounced standardised patients in real practice: A systematic literature review. Med Educ 2007;41:537-49.
13.	Glassman PA, Luck J, O'Gara EM, Peabody JW. Using standardized patients to measure quality: Evidence from the literature and a prospective study. Jt Comm J Qual Improv 2000;26:644-53.
14.	Campbell K, Engel H, Timperio A, Cooper C, Crawford D. Obesity management: Australian general practitioners' attitudes and practices. Obes Res 2000;8:459-66.
15.	Bocquier A, Verger P, Basdevant A, Andreotti G, Baretge J, Villani P, et al. Overweight and obesity: Knowledge, attitudes, and practices of general practitioners in France. Obes Res 2005;13:787-95.
16.	Klumbiene J, Petkeviciene J, Vaisvalavicius V, Miseviciene I. Advising overweight persons about diet and physical activity in primary health care: Lithuanian health behaviour monitoring study. BMC Public Health 2006;6:30.
17.	Thuan JF, Avignon A. Obesity management: Attitudes and practices of French general practitioners in a region of France. Int J Obes (Lond) 2005;29:1100-6.
18.	Tamblyn RM, Abrahamowicz M, Berkson L, Dauphinee WD, Gayton DC, Grad RM, et al. First-visit bias in the measurement of clinical competence with standardized patients. Acad Med 1992;67 (Suppl 10):S22-4.
19.	McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods 1996;1:30-46.

Advanced Biomedical Research