{"id":3440,"date":"2019-09-26T11:35:56","date_gmt":"2019-09-26T15:35:56","guid":{"rendered":"https:\/\/www.ecfmg.org\/news\/?p=3440"},"modified":"2019-09-26T11:35:56","modified_gmt":"2019-09-26T15:35:56","slug":"computer-assisted-scoring-coming-to-step-2-cs","status":"publish","type":"post","link":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/","title":{"rendered":"Computer-Assisted Scoring Coming to Step 2 CS"},"content":{"rendered":"<p>The United States Medical Licensing Examination<sup>\u00ae<\/sup> (USMLE<sup>\u00ae<\/sup>) program is committed to applying the best available technology and the most current assessment practices to ensure accuracy and validity for all its examination programs. Beginning October 2019, computer-assisted scoring technology will be used to score patient notes created by examinees for the USMLE Step 2 Clinical Skills (CS) examination.<\/p>\n<p>The use of computer-assisted scoring will not change the cost of the exam, nor the timing with which examinees receive their scores. The computer-assisted scoring program is based on the scoring rubrics developed by experienced physician note raters. For cases in which computer-assisted scoring is used, notes with machine scores below the 50th percentile in performance will also be scored by physician patient note raters. The machine scores and physician scores will then be averaged to produce the examinee\u2019s score on the patient note portion of the Step 2 CS exam.<\/p>\n<p>Much consideration has gone into the implementation of computer-assisted scoring. Most importantly, the crucial role of clinical judgment in the evaluation of Step 2 CS performances will be preserved. Second, the examinee experience will not be adversely affected. The expert judgment of physicians will be used on an ongoing basis for the development of patient note scoring guidelines and in the training of the computer-based scoring system.<\/p>\n<p>Click <a href=\"https:\/\/protect-us.mimecast.com\/s\/cdERCpYom6S2AgvtPF9Pz?domain=usmle.org\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a> for FAQs related to computer-assisted scoring. To read more about NBME\u2019s work with natural language processing, see a recent article in Academic Medicine <a href=\"https:\/\/protect-us.mimecast.com\/s\/tt_8CqxpnXfQXgzFXliYr?domain=journals.lww.com\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>.<\/p>\n<p>Examinees should monitor the\u00a0<a href=\"http:\/\/www.usmle.org\/\" target=\"_blank\" rel=\"noopener noreferrer\">USMLE website<\/a>\u00a0for the latest information.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The United States Medical Licensing Examination\u00ae (USMLE\u00ae) program is committed to applying the best available technology and the most current assessment practices to ensure accuracy and validity for all its examination programs. Beginning October 2019, computer-assisted scoring technology will be used to score patient notes created by examinees for the USMLE Step 2 Clinical Skills &#8230; <a href=\"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/\" class=\"more-link\"><span class=\"screen-reader-text\">  Read More  <i class=\"fas fa-arrow-right\"><\/i><\/span><\/a><\/p>\n","protected":false},"author":12,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,5],"tags":[],"class_list":["post-3440","post","type-post","status-publish","format-standard","hentry","category-exam-preparation","category-step-2-cs"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News<\/title>\n<meta name=\"description\" content=\"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News\" \/>\n<meta property=\"og:description\" content=\"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/\" \/>\n<meta property=\"og:site_name\" content=\"ECFMG News\" \/>\n<meta property=\"article:published_time\" content=\"2019-09-26T15:35:56+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ecfmg.org\/news\/wp-content\/uploads\/2023\/03\/ECFMG-OG-1200x680-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"ECFMG User3\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"ECFMG User3\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/2019\\\/09\\\/26\\\/computer-assisted-scoring-coming-to-step-2-cs\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/2019\\\/09\\\/26\\\/computer-assisted-scoring-coming-to-step-2-cs\\\/\"},\"author\":{\"name\":\"ECFMG User3\",\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/#\\\/schema\\\/person\\\/8fe5f049d6a1411dc2f9ff9e34d5d8b6\"},\"headline\":\"Computer-Assisted Scoring Coming to Step 2 CS\",\"datePublished\":\"2019-09-26T15:35:56+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/2019\\\/09\\\/26\\\/computer-assisted-scoring-coming-to-step-2-cs\\\/\"},\"wordCount\":255,\"articleSection\":[\"Exam Preparation\",\"Step 2 CS\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/2019\\\/09\\\/26\\\/computer-assisted-scoring-coming-to-step-2-cs\\\/\",\"url\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/2019\\\/09\\\/26\\\/computer-assisted-scoring-coming-to-step-2-cs\\\/\",\"name\":\"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/#website\"},\"datePublished\":\"2019-09-26T15:35:56+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/#\\\/schema\\\/person\\\/8fe5f049d6a1411dc2f9ff9e34d5d8b6\"},\"description\":\"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/2019\\\/09\\\/26\\\/computer-assisted-scoring-coming-to-step-2-cs\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/2019\\\/09\\\/26\\\/computer-assisted-scoring-coming-to-step-2-cs\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/2019\\\/09\\\/26\\\/computer-assisted-scoring-coming-to-step-2-cs\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Computer-Assisted Scoring Coming to Step 2 CS\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/#website\",\"url\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/\",\"name\":\"ECFMG News\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.ecfmg.org\\\/news\\\/#\\\/schema\\\/person\\\/8fe5f049d6a1411dc2f9ff9e34d5d8b6\",\"name\":\"ECFMG User3\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News","description":"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/","og_locale":"en_US","og_type":"article","og_title":"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News","og_description":"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News","og_url":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/","og_site_name":"ECFMG News","article_published_time":"2019-09-26T15:35:56+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/www.ecfmg.org\/news\/wp-content\/uploads\/2023\/03\/ECFMG-OG-1200x680-1.png","type":"image\/png"}],"author":"ECFMG User3","twitter_misc":{"Written by":"ECFMG User3","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/#article","isPartOf":{"@id":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/"},"author":{"name":"ECFMG User3","@id":"https:\/\/www.ecfmg.org\/news\/#\/schema\/person\/8fe5f049d6a1411dc2f9ff9e34d5d8b6"},"headline":"Computer-Assisted Scoring Coming to Step 2 CS","datePublished":"2019-09-26T15:35:56+00:00","mainEntityOfPage":{"@id":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/"},"wordCount":255,"articleSection":["Exam Preparation","Step 2 CS"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/","url":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/","name":"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News","isPartOf":{"@id":"https:\/\/www.ecfmg.org\/news\/#website"},"datePublished":"2019-09-26T15:35:56+00:00","author":{"@id":"https:\/\/www.ecfmg.org\/news\/#\/schema\/person\/8fe5f049d6a1411dc2f9ff9e34d5d8b6"},"description":"Computer-Assisted Scoring Coming to Step 2 CS - ECFMG News","breadcrumb":{"@id":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ecfmg.org\/news\/2019\/09\/26\/computer-assisted-scoring-coming-to-step-2-cs\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ecfmg.org\/news\/"},{"@type":"ListItem","position":2,"name":"Computer-Assisted Scoring Coming to Step 2 CS"}]},{"@type":"WebSite","@id":"https:\/\/www.ecfmg.org\/news\/#website","url":"https:\/\/www.ecfmg.org\/news\/","name":"ECFMG News","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ecfmg.org\/news\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.ecfmg.org\/news\/#\/schema\/person\/8fe5f049d6a1411dc2f9ff9e34d5d8b6","name":"ECFMG User3"}]}},"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/posts\/3440","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/comments?post=3440"}],"version-history":[{"count":1,"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/posts\/3440\/revisions"}],"predecessor-version":[{"id":3441,"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/posts\/3440\/revisions\/3441"}],"wp:attachment":[{"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/media?parent=3440"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/categories?post=3440"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ecfmg.org\/news\/wp-json\/wp\/v2\/tags?post=3440"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}