Operative performance in laparoscopic cholecystectomy using the Procedural-Based Assessment tool
Received 22 July 2009; received in revised form 15 October 2009 published online 24 June 2010.
Abstract
Aims
The Intercollegiate Surgical Curriculum Project (ISCP) has devised assessment tools for index operations to assess trainee technical skills. In this study we used the Procedural-Based Assessment (PBA) tool to evaluate operations performed by trainees.
Methods
Live and simulated laparoscopic cholecystectomies were performed by trainees. Two experienced surgeons assessed each operation blindly and independently.
Results
Eighty-four live (supervised) and 112 simulated (unsupervised) operations were performed by 28 trainees. Mean inter-rater reliability was kappa = .86 and .84 for live and simulated operations, respectively. Construct validity using Mann–Whitney for generic technical skills was significant for live and simulated operations, P ≤ .05. Assessing specific technical skills showed construct validity for simulated unsupervised operations only, Mann–Whitney P < .05, but not for supervised live operations, Mann–Whitney P > .05.
Conclusions
The PBA showed good inter-rater reliability. Assessing generic technical skills, PBA showed construct validity for both types of operations and for specific technical skills in the unsupervised simulated operations. We conclude that the PBA seems to be a reliable and valid assessment tool for generic technical skills in unsupervised simulated and live supervised laparoscopic cholecystectomies.
ABSTRACT