Computer-Assisted Scoring Coming to Step 2 CS

The United States Medical Licensing Examination® (USMLE®) program is committed to applying the best available technology and the most current assessment practices to ensure accuracy and validity for all its examination programs. Beginning October 2019, computer-assisted scoring technology will be used to score patient notes created by examinees for the USMLE Step 2 Clinical Skills (CS) examination.

The use of computer-assisted scoring will not change the cost of the exam, nor the timing with which examinees receive their scores. The computer-assisted scoring program is based on the scoring rubrics developed by experienced physician note raters. For cases in which computer-assisted scoring is used, notes with machine scores below the 50th percentile in performance will also be scored by physician patient note raters. The machine scores and physician scores will then be averaged to produce the examinee’s score on the patient note portion of the Step 2 CS exam.

Much consideration has gone into the implementation of computer-assisted scoring. Most importantly, the crucial role of clinical judgment in the evaluation of Step 2 CS performances will be preserved. Second, the examinee experience will not be adversely affected. The expert judgment of physicians will be used on an ongoing basis for the development of patient note scoring guidelines and in the training of the computer-based scoring system.

Click here for FAQs related to computer-assisted scoring. To read more about NBME’s work with natural language processing, see a recent article in Academic Medicine here.

Examinees should monitor the USMLE website for the latest information.

Step 3 – Delay in Score Reporting

If you need to receive Step 3 scores before March 25, 2020, the United States Medical Licensing Examination® (USMLE®) recommends that you take the exam no later than December 31, 2019.

Most Step 3 scores are reported within four weeks of testing. However, because of necessary annual modifications to the test item pool, there will be a delay in reporting for some examinees who test in early 2020. The target date for reporting Step 3 scores for examinees testing in January and February 2020 is Wednesday, March 25, 2020.

No USMLE Step 1, Step 2 CK, or Step 3 examinations will be administered January 1-14, 2020.

Examinees should monitor the USMLE website for the latest information.

Step 1 and Step 2 CK – Score Delays in 2020

Most Step 1 and Step 2 Clinical Knowledge (CK) scores are reported within four weeks of testing. However, because of necessary annual modifications to the test item pools, delays occur for examinees who test at certain times of the year.

The United States Medical Licensing Examination® (USMLE®) has announced that examinees testing during the following dates may experience delays in score reporting:

  • Step 1 examinees testing early May through early July 2020 – more specific information will be posted January 2020
  • Step 2 CK examinees testing late June through late August 2020 – more specific information will be posted March 2020

Why is this important to know?

If you need to receive a score before a certain date, plan to take that exam before the projected score delay windows to avoid missing deadlines.

Examinees should monitor the USMLE website for more information.

New Videos from USMLE: “Your USMLE Journey to Medical Licensure in the U.S.” and “Who is USMLE?”

Two new videos about the United States Medical Licensing Examination® (USMLE®) program are now available on the USMLE website for students, examinees, medical school faculty, and others.

“Your USMLE Journey to Medical Licensure in the U.S.” looks at what is covered on each Step exam, using colorful scenes and visual elements.

“Who is USMLE?” features program volunteers and committee members who help develop the exams, discussing the perspectives and principles behind work on a licensure examination.

The new videos are a great way to quickly understand the exams that comprise the three Steps of USMLE.

In addition, the USMLE website now includes an easy to locate page for quick access to all videos and podcasts supporting program information.

Keep checking the USMLE Announcements section for news, videos, and podcasts to stay aware of program updates.

Step 2 CK – Delay in Score Reporting

Most score reporting of Step 2 Clinical Knowledge (CK) results occurs within four weeks of testing. However, because of necessary modifications to the test item pool, there will be a delay in reporting for some examinees who test beginning the week of June 23, 2019.

The target date for reporting Step 2 CK scores for most examinees testing the week of June 23 through August 8 will be Wednesday, August 28, 2019. For examinees whose circumstances require that they receive Step 2 CK scores before August 28, 2019, it is recommended that they take the exam no later than June 24, 2019.

Although the transition will occur quickly at many test centers, there may be some locations where the changes take slightly longer to complete. The overall transition period will likely last approximately six weeks. Please note that scores on new and old exam forms will be comparable.

Examinees should monitor the USMLE website for the latest information.

Step 1 – Delay in Score Reporting

Most score reporting of USMLE Step 1 results occurs within four weeks of testing. However, because of necessary modifications to the test item pool, there will be a delay in reporting for some examinees who test beginning the week of May 5, 2019.

The target date for reporting Step 1 scores for most examinees testing the week of May 5 through mid-June will be Wednesday, July 10, 2019. For examinees whose circumstances require that they receive Step 1 scores before July 10, 2019, it is recommended that they take Step 1 no later than May 4, 2019.

Examinees should see the full announcement on the USMLE website for more information.

New Score Report Format – USMLE Step 1 and Step 2 CK Examinations

A redesigned version of the USMLE Step 3 examination score was implemented for examinees testing on or after October 1, 2018. The new format is now being implemented for the Step 1 and Step 2 CK examinations. Examinees taking Step 1 and Step 2 CK on or after January 15, 2019 will receive the new score report.

The redesigned report features a chart showing an examinee’s performance compared with recent first-time takers from U.S. and Canadian medical schools, the examinee’s performance in individual content areas relative to their overall Step examination performance, and information about the allocation of items across each content area.

You can view the new score report on the USMLE website here. Click on the comment boxes for explanatory/informational text. FAQs about the score report are also available on the USMLE website.

The USMLE program solicited feedback on the new design from a number of stakeholders, including examinees, medical school faculty, and residency program directors.

A new score report format for the Step 2 Clinical Skills (CS) examination is under development.

Questions or comments? Please send them to the USMLE program via the web form located here.

Examinees should monitor the USMLE website for the latest information.

USMLE Score Reporting Schedule

USMLE scores will be released as regularly scheduled on Wednesday, December 19, 2018. Step 2 Clinical Skills (CS) score reports only will be released on Wednesday, December 26, 2018.

Regularly scheduled score reporting for all USMLE exams will resume Wednesday, January 2, 2019.

Examinees should monitor the USMLE website for the latest information.

Final Diagnosis Screen Removed from USMLE Step 3 CCS Cases

Step 3 examinees will no longer be asked to enter information regarding a final diagnosis before ending a computer-based case simulation (CCS) case. Most examinees who test on or after January 1, 2019 will not see the final diagnosis screen at the end of a CCS case. Although the transition will occur quickly at many test centers, there may be some locations where the changes take slightly longer to complete. The overall transition period will likely last approximately 6 weeks.

This change does not affect the scoring of the CCS cases in any way. Final diagnoses have never been used in scoring an examinee performance.

Examinees should monitor the USMLE website for the latest information.