author_facet Cheung, Warren J.
Dudek, Nancy
Wood, Timothy J.
Frank, Jason R.
Cheung, Warren J.
Dudek, Nancy
Wood, Timothy J.
Frank, Jason R.
author Cheung, Warren J.
Dudek, Nancy
Wood, Timothy J.
Frank, Jason R.
spellingShingle Cheung, Warren J.
Dudek, Nancy
Wood, Timothy J.
Frank, Jason R.
Journal of Graduate Medical Education
Daily Encounter Cards—Evaluating the Quality of Documented Assessments
General Medicine
author_sort cheung, warren j.
spelling Cheung, Warren J. Dudek, Nancy Wood, Timothy J. Frank, Jason R. 1949-8349 1949-8357 Journal of Graduate Medical Education General Medicine http://dx.doi.org/10.4300/jgme-d-15-00505.1 <jats:title>ABSTRACT</jats:title> <jats:sec> <jats:title>Background </jats:title> <jats:p>Concerns over the quality of work-based assessment (WBA) completion has resulted in faculty development and rater training initiatives. Daily encounter cards (DECs) are a common form of WBA used in ambulatory care and shift work settings. A tool is needed to evaluate initiatives aimed at improving the quality of completion of this widely used form of WBA.</jats:p> </jats:sec> <jats:sec> <jats:title>Objective </jats:title> <jats:p>The completed clinical evaluation report rating (CCERR) was designed to provide a measure of the quality of documented assessments on in-training evaluation reports. The purpose of this study was to provide validity evidence to support using the CCERR to assess the quality of DEC completion.</jats:p> </jats:sec> <jats:sec> <jats:title>Methods </jats:title> <jats:p>Six experts in resident assessment grouped 60 DECs into 3 quality categories (high, average, and poor) based on how informative each DEC was for reporting judgments of the resident's performance. Eight supervisors (blinded to the expert groupings) scored the 10 most representative DECs in each group using the CCERR. Mean scores were compared to determine if the CCERR could discriminate based on DEC quality.</jats:p> </jats:sec> <jats:sec> <jats:title>Results </jats:title> <jats:p>Statistically significant differences in CCERR scores were observed between all quality groups (P &amp;lt; .001). A generalizability analysis demonstrated the majority of score variation was due to differences in DECs. The reliability with a single rater was 0.95.</jats:p> </jats:sec> <jats:sec> <jats:title>Conclusions </jats:title> <jats:p>The CCERR is a reliable and valid tool to evaluate DEC quality. It can serve as an outcome measure for studying interventions targeted at improving the quality of assessments documented on DECs.</jats:p> </jats:sec> Daily Encounter Cards—Evaluating the Quality of Documented Assessments Journal of Graduate Medical Education
doi_str_mv 10.4300/jgme-d-15-00505.1
facet_avail Online
Free
format ElectronicArticle
fullrecord blob:ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuNDMwMC9qZ21lLWQtMTUtMDA1MDUuMQ
id ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuNDMwMC9qZ21lLWQtMTUtMDA1MDUuMQ
institution DE-Bn3
DE-Brt1
DE-Zwi2
DE-D161
DE-Gla1
DE-Zi4
DE-15
DE-Pl11
DE-Rs1
DE-105
DE-14
DE-Ch1
DE-L229
DE-D275
imprint Journal of Graduate Medical Education, 2016
imprint_str_mv Journal of Graduate Medical Education, 2016
issn 1949-8357
1949-8349
issn_str_mv 1949-8357
1949-8349
language English
mega_collection Journal of Graduate Medical Education (CrossRef)
match_str cheung2016dailyencountercardsevaluatingthequalityofdocumentedassessments
publishDateSort 2016
publisher Journal of Graduate Medical Education
recordtype ai
record_format ai
series Journal of Graduate Medical Education
source_id 49
title Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_unstemmed Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_full Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_fullStr Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_full_unstemmed Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_short Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_sort daily encounter cards—evaluating the quality of documented assessments
topic General Medicine
url http://dx.doi.org/10.4300/jgme-d-15-00505.1
publishDate 2016
physical 601-604
description <jats:title>ABSTRACT</jats:title> <jats:sec> <jats:title>Background </jats:title> <jats:p>Concerns over the quality of work-based assessment (WBA) completion has resulted in faculty development and rater training initiatives. Daily encounter cards (DECs) are a common form of WBA used in ambulatory care and shift work settings. A tool is needed to evaluate initiatives aimed at improving the quality of completion of this widely used form of WBA.</jats:p> </jats:sec> <jats:sec> <jats:title>Objective </jats:title> <jats:p>The completed clinical evaluation report rating (CCERR) was designed to provide a measure of the quality of documented assessments on in-training evaluation reports. The purpose of this study was to provide validity evidence to support using the CCERR to assess the quality of DEC completion.</jats:p> </jats:sec> <jats:sec> <jats:title>Methods </jats:title> <jats:p>Six experts in resident assessment grouped 60 DECs into 3 quality categories (high, average, and poor) based on how informative each DEC was for reporting judgments of the resident's performance. Eight supervisors (blinded to the expert groupings) scored the 10 most representative DECs in each group using the CCERR. Mean scores were compared to determine if the CCERR could discriminate based on DEC quality.</jats:p> </jats:sec> <jats:sec> <jats:title>Results </jats:title> <jats:p>Statistically significant differences in CCERR scores were observed between all quality groups (P &amp;lt; .001). A generalizability analysis demonstrated the majority of score variation was due to differences in DECs. The reliability with a single rater was 0.95.</jats:p> </jats:sec> <jats:sec> <jats:title>Conclusions </jats:title> <jats:p>The CCERR is a reliable and valid tool to evaluate DEC quality. It can serve as an outcome measure for studying interventions targeted at improving the quality of assessments documented on DECs.</jats:p> </jats:sec>
container_issue 4
container_start_page 601
container_title Journal of Graduate Medical Education
container_volume 8
format_de105 Article, E-Article
format_de14 Article, E-Article
format_de15 Article, E-Article
format_de520 Article, E-Article
format_de540 Article, E-Article
format_dech1 Article, E-Article
format_ded117 Article, E-Article
format_degla1 E-Article
format_del152 Buch
format_del189 Article, E-Article
format_dezi4 Article
format_dezwi2 Article, E-Article
format_finc Article, E-Article
format_nrw Article, E-Article
_version_ 1792338287514353665
geogr_code not assigned
last_indexed 2024-03-01T15:29:50.233Z
geogr_code_person not assigned
openURL url_ver=Z39.88-2004&ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fvufind.svn.sourceforge.net%3Agenerator&rft.title=Daily+Encounter+Cards%E2%80%94Evaluating+the+Quality+of+Documented+Assessments&rft.date=2016-10-01&genre=article&issn=1949-8357&volume=8&issue=4&spage=601&epage=604&pages=601-604&jtitle=Journal+of+Graduate+Medical+Education&atitle=Daily+Encounter+Cards%E2%80%94Evaluating+the+Quality+of+Documented+Assessments&aulast=Frank&aufirst=Jason+R.&rft_id=info%3Adoi%2F10.4300%2Fjgme-d-15-00505.1&rft.language%5B0%5D=eng
SOLR
_version_ 1792338287514353665
author Cheung, Warren J., Dudek, Nancy, Wood, Timothy J., Frank, Jason R.
author_facet Cheung, Warren J., Dudek, Nancy, Wood, Timothy J., Frank, Jason R., Cheung, Warren J., Dudek, Nancy, Wood, Timothy J., Frank, Jason R.
author_sort cheung, warren j.
container_issue 4
container_start_page 601
container_title Journal of Graduate Medical Education
container_volume 8
description <jats:title>ABSTRACT</jats:title> <jats:sec> <jats:title>Background </jats:title> <jats:p>Concerns over the quality of work-based assessment (WBA) completion has resulted in faculty development and rater training initiatives. Daily encounter cards (DECs) are a common form of WBA used in ambulatory care and shift work settings. A tool is needed to evaluate initiatives aimed at improving the quality of completion of this widely used form of WBA.</jats:p> </jats:sec> <jats:sec> <jats:title>Objective </jats:title> <jats:p>The completed clinical evaluation report rating (CCERR) was designed to provide a measure of the quality of documented assessments on in-training evaluation reports. The purpose of this study was to provide validity evidence to support using the CCERR to assess the quality of DEC completion.</jats:p> </jats:sec> <jats:sec> <jats:title>Methods </jats:title> <jats:p>Six experts in resident assessment grouped 60 DECs into 3 quality categories (high, average, and poor) based on how informative each DEC was for reporting judgments of the resident's performance. Eight supervisors (blinded to the expert groupings) scored the 10 most representative DECs in each group using the CCERR. Mean scores were compared to determine if the CCERR could discriminate based on DEC quality.</jats:p> </jats:sec> <jats:sec> <jats:title>Results </jats:title> <jats:p>Statistically significant differences in CCERR scores were observed between all quality groups (P &amp;lt; .001). A generalizability analysis demonstrated the majority of score variation was due to differences in DECs. The reliability with a single rater was 0.95.</jats:p> </jats:sec> <jats:sec> <jats:title>Conclusions </jats:title> <jats:p>The CCERR is a reliable and valid tool to evaluate DEC quality. It can serve as an outcome measure for studying interventions targeted at improving the quality of assessments documented on DECs.</jats:p> </jats:sec>
doi_str_mv 10.4300/jgme-d-15-00505.1
facet_avail Online, Free
format ElectronicArticle
format_de105 Article, E-Article
format_de14 Article, E-Article
format_de15 Article, E-Article
format_de520 Article, E-Article
format_de540 Article, E-Article
format_dech1 Article, E-Article
format_ded117 Article, E-Article
format_degla1 E-Article
format_del152 Buch
format_del189 Article, E-Article
format_dezi4 Article
format_dezwi2 Article, E-Article
format_finc Article, E-Article
format_nrw Article, E-Article
geogr_code not assigned
geogr_code_person not assigned
id ai-49-aHR0cDovL2R4LmRvaS5vcmcvMTAuNDMwMC9qZ21lLWQtMTUtMDA1MDUuMQ
imprint Journal of Graduate Medical Education, 2016
imprint_str_mv Journal of Graduate Medical Education, 2016
institution DE-Bn3, DE-Brt1, DE-Zwi2, DE-D161, DE-Gla1, DE-Zi4, DE-15, DE-Pl11, DE-Rs1, DE-105, DE-14, DE-Ch1, DE-L229, DE-D275
issn 1949-8357, 1949-8349
issn_str_mv 1949-8357, 1949-8349
language English
last_indexed 2024-03-01T15:29:50.233Z
match_str cheung2016dailyencountercardsevaluatingthequalityofdocumentedassessments
mega_collection Journal of Graduate Medical Education (CrossRef)
physical 601-604
publishDate 2016
publishDateSort 2016
publisher Journal of Graduate Medical Education
record_format ai
recordtype ai
series Journal of Graduate Medical Education
source_id 49
spelling Cheung, Warren J. Dudek, Nancy Wood, Timothy J. Frank, Jason R. 1949-8349 1949-8357 Journal of Graduate Medical Education General Medicine http://dx.doi.org/10.4300/jgme-d-15-00505.1 <jats:title>ABSTRACT</jats:title> <jats:sec> <jats:title>Background </jats:title> <jats:p>Concerns over the quality of work-based assessment (WBA) completion has resulted in faculty development and rater training initiatives. Daily encounter cards (DECs) are a common form of WBA used in ambulatory care and shift work settings. A tool is needed to evaluate initiatives aimed at improving the quality of completion of this widely used form of WBA.</jats:p> </jats:sec> <jats:sec> <jats:title>Objective </jats:title> <jats:p>The completed clinical evaluation report rating (CCERR) was designed to provide a measure of the quality of documented assessments on in-training evaluation reports. The purpose of this study was to provide validity evidence to support using the CCERR to assess the quality of DEC completion.</jats:p> </jats:sec> <jats:sec> <jats:title>Methods </jats:title> <jats:p>Six experts in resident assessment grouped 60 DECs into 3 quality categories (high, average, and poor) based on how informative each DEC was for reporting judgments of the resident's performance. Eight supervisors (blinded to the expert groupings) scored the 10 most representative DECs in each group using the CCERR. Mean scores were compared to determine if the CCERR could discriminate based on DEC quality.</jats:p> </jats:sec> <jats:sec> <jats:title>Results </jats:title> <jats:p>Statistically significant differences in CCERR scores were observed between all quality groups (P &amp;lt; .001). A generalizability analysis demonstrated the majority of score variation was due to differences in DECs. The reliability with a single rater was 0.95.</jats:p> </jats:sec> <jats:sec> <jats:title>Conclusions </jats:title> <jats:p>The CCERR is a reliable and valid tool to evaluate DEC quality. It can serve as an outcome measure for studying interventions targeted at improving the quality of assessments documented on DECs.</jats:p> </jats:sec> Daily Encounter Cards—Evaluating the Quality of Documented Assessments Journal of Graduate Medical Education
spellingShingle Cheung, Warren J., Dudek, Nancy, Wood, Timothy J., Frank, Jason R., Journal of Graduate Medical Education, Daily Encounter Cards—Evaluating the Quality of Documented Assessments, General Medicine
title Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_full Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_fullStr Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_full_unstemmed Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_short Daily Encounter Cards—Evaluating the Quality of Documented Assessments
title_sort daily encounter cards—evaluating the quality of documented assessments
title_unstemmed Daily Encounter Cards—Evaluating the Quality of Documented Assessments
topic General Medicine
url http://dx.doi.org/10.4300/jgme-d-15-00505.1