Training and validation of standardized patients for evaluation of general practitioners' performance in management of obesity and overweight

Authors
Tahereh Changiz 1
Sepideh Jamshidian 1
Mohamad Hassan Entezari 2
Nazila Kassaian 3
1 Department of Medical Education, Medical Education Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
2 Department of Clinical Nutrition, School of Nutrition and Food Sciences, Food Security Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
3 Department of Medical Education, School of Medical Education, Shahid Beheshti University of Medical Sciences, Tehran, Iran
Abstract
Background: Standardized patient (SP) can serve as a valuable tool to measure the physician performance in actual clinical settings, but it has not been validated for obesity/overweight disorders. This study has been conducted to describe the process of creating reliable and valid SPs for evaluation of general-practitioners' management of obesity/overweight in Iran.
Materials and Methods: A total of 6 obese/overweight volunteers (potential SPs) took part in training. Three scenarios, along with corresponding checklists including 102 items representing different aspects of diagnosis and treatment of obesity/overweight, were developed by an expert group. The SPs were trained using role playing method. During this part, one of the SPs failed. The SPs' portrayal of their respective scenario was online watched in another room and the checklist filled independently by the physician, research assistant and other SPs. The reliability of the checklist to be used by the SPs was assessed by Cronbach's alpha. The overall inter-rater agreement was calculated by the intraclass correlation coefficient statistic for total scores.
Results: The 5 eligible SPs were all women between 20 years and 39 years of age. Inter-rater agreement between the SPs' total scores was 0.899, value (95% confidence intervals) were 11.8 (0.68-0.98) and P value was <0.001. The Cronbach's alpha for reliability of completed checklists was 0.91.
Conclusion: SP could be a powerful instrument for evaluating medical performance of general practitioners in the field of obesity/overweight management. Further research is needed to find the more aspects of training and validation of unannounced SPs in this field.

Keywords

1. Mokdad AH, Ford ES, Bowman BA, Dietz WH, Vinicor F, Bales VS, et al. Prevalence of obesity, diabetes, and obesity-related health risk factors, 2001. JAMA 2003;289:76-9.  Back to cited text no. 1
    
2. Akhavan A, Kelishadi R, Sadri GH, Sabet B, Toloui R, Baghai AH. Prevalence of obesity in central part of Iran: Healthy heart project. J Gazvin Univ Med Sci 2003;26:27-35.  Back to cited text no. 2
    
3. Martin PD, Dutton GR, Rhode PC, Horswell RL, Ryan DH, Brantley PJ. Weight loss maintenance following a primary care intervention for low-income minority women. Obesity (Silver Spring) 2008;16:2462-7.  Back to cited text no. 3
    
4. Potter MB, Vu JD, Croughan-Minihane M. Weight management: What patients want from their primary care physicians. J Fam Pract 2001;50:513-8.  Back to cited text no. 4
    
5. Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: A prospective validation study of 3 methods for measuring quality. JAMA 2000;283:1715-22.  Back to cited text no. 5
    
6. Fihn SD. The quest to quantify quality. JAMA 2000;283:1740-2.  Back to cited text no. 6
    
7. Tamblyn RM. Use of standardized patients in the assessment of medical practice. Can Med Assoc J 1998;158:205-7.  Back to cited text no. 7
    
8. Shirazi M, Sadeghi M, Emami A, Kashani AS, Parikh S, Alaeddini F, et al. Training and validation of standardized patients for unannounced assessment of physicians' management of depression. Acad Psychiatry 2011;35:382-7.  Back to cited text no. 8
    
9. National Institutes of Health. Clinical Guidelines on the Identification Evaluation and Treatment of Overweight and Obesity in Adults. New York (USA): NIH Publication; 1998.  Back to cited text no. 9
    
10. Scottish Intercollegiate Guidelines Network. Management of Obesity: A National Clinical Guideline, 2010. Available from: http://www.sign.ac.uk./guidelines/index.html [Last accessed on 2012 Feb 25].  Back to cited text no. 10
    
11. Health Team Works. Adults Obesity Guideline: Weight Assessment and Management Algorithm, 2011. Available from: http://www.healthteamworks.org/guidelines/obesity.html [Last accessed on 2012 Feb 24].  Back to cited text no. 11
    
12. Rethans JJ, Gorter S, Bokken L, Morrison L. Unannounced standardised patients in real practice: A systematic literature review. Med Educ 2007;41:537-49.  Back to cited text no. 12
    
13. Glassman PA, Luck J, O'Gara EM, Peabody JW. Using standardized patients to measure quality: Evidence from the literature and a prospective study. Jt Comm J Qual Improv 2000;26:644-53.  Back to cited text no. 13
    
14. Campbell K, Engel H, Timperio A, Cooper C, Crawford D. Obesity management: Australian general practitioners' attitudes and practices. Obes Res 2000;8:459-66.  Back to cited text no. 14
    
15. Bocquier A, Verger P, Basdevant A, Andreotti G, Baretge J, Villani P, et al. Overweight and obesity: Knowledge, attitudes, and practices of general practitioners in France. Obes Res 2005;13:787-95.  Back to cited text no. 15
    
16. Klumbiene J, Petkeviciene J, Vaisvalavicius V, Miseviciene I. Advising overweight persons about diet and physical activity in primary health care: Lithuanian health behaviour monitoring study. BMC Public Health 2006;6:30.  Back to cited text no. 16
    
17. Thuan JF, Avignon A. Obesity management: Attitudes and practices of French general practitioners in a region of France. Int J Obes (Lond) 2005;29:1100-6.  Back to cited text no. 17
    
18. Tamblyn RM, Abrahamowicz M, Berkson L, Dauphinee WD, Gayton DC, Grad RM, et al. First-visit bias in the measurement of clinical competence with standardized patients. Acad Med 1992;67 (Suppl 10):S22-4.  Back to cited text no. 18
    
19. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods 1996;1:30-46.  Back to cited text no. 19
Advanced Biomedical Research
Volume 2014, January
January 2014
Pages 1-5