Tetsurou Watari

BACKGROUND: Newly graduated physical therapists require effective training to enhance their clinical skills. On-the-job training (OJT) and off-the-job training (Off-JT) are commonly used methods, but their comparative effectiveness remains unclear. This study aimed to compare the effectiveness of OJT and Off-JT in improving the clinical competencies of newly graduated physical therapists. MATERIAL AND METHODS: A crossover study was conducted involving 13 newly graduated physical therapists. Participants alternated between OJT and Off-JT interventions. The objective-structured clinical examination assessed four key skills—joint range of motion measurement, muscle testing, assistance in getting up, and assistance in transferring. Evaluations were conducted at four time points. A Mann–Whitney U -test was used to compare the change in average scores between the two groups from Assessment 1 to Assessment 2. A two-way analysis of variance was conducted to analyze the interaction effects of training methods and assessment timing. RESULTS: Off-JT was more effective than OJT in improving clinical skills, especially in muscle testing and patient assistance tasks. Both training methods enhanced joint range of motion measurement skills; however, no significant differences were found between the groups. Some tasks showed performance declines in the final assessment, indicating the necessity of continued practice. CONCLUSIONS: Off-JT provides a more effective approach for improving clinical skills, particularly for tasks that require specialized knowledge and structured learning. However, OJT remains valuable for reinforcing routine clinical tasks. Future research should explore the long-term effects of these training methods on various clinical competencies.

Objectives: Objective structured clinical examinations (OSCEs) are used to assess clinical competence in medical education. Evaluations using video-recorded OSCEs are effective in reducing costs in terms of time and human resources. To improve inter-rater reliability, these evaluations undergo moderation in the form of a discussion between the raters to obtain consistency in grading according to the rubric criteria. We examined the effect of moderation related to the rubric criteria on the inter-rater reliability of a video-recorded OSCE with real patients. Methods: Forty OSCE videos in which students performed range-of-motion tests at shoulder abduction on real patients were assessed by two raters. The two raters scored videos 1 to 10 without moderation and videos 11 to 40 with moderation each time. The inter-rater reliability of the OSCE was calculated using the weighted kappa coefficient. Results: The mean scores of the weighted kappa coefficients were 0.49 for videos 1 to 10, 0.57 for videos 11 to 20, 0.66 for videos 21 to 30, and 0.82 for videos 31 to 40. Conclusions: An assessment of video-recorded OSCEs was conducted with real patients in a real clinical setting. Repeated moderation improved the inter-rater reliability. This study suggests the effectiveness of moderation in OSCEs with real patients.