Catheter insertion simulation with combined visual and haptic feedback

Abstract

We have developed an experimental catheter insertion system supporting head-tracked stereoscopic viewing of volumetric reconstruction registered with direct haptic 3D interaction. The system takes as input patient data acquired with standard medical imaging modalities and regards it as a visual and haptic environment whose parameters are defined using look-up tables. By means of a mirror, the screen seems to be positioned like a surgical table providing the impression of looking down at the patient in a natural way. Co-registering physical and virtual spaces beforehand means that the patient appears at a fixed physical positionj on the surgical table and inside the workspace of the PHANToM device which controls catheter insertion. During the insertion procedure the system provides perception of the force of penetration and positional deviation of the inserted catheter.