Grants and Contributions:

Grant or Award spanning more than one fiscal year. (2017-2018 to 2022-2023)

As technology advances our ability to create Virtual Reality (VR) environments, there is now the capability of increasing realism, particularly for training purposes. The focus of this proposal is on Haptic Audio Visual Environments (HAVEs). The particular application that will be the focus of this study is pedicle screw insertion for correcting deformities in idiopathic scoliosis. This is a highly risky surgery which currently has training accomplished either through the use of cadavers (where the change in material properties and the lack of blood pressure is a hindrance) or in the actual operating room on a live patient. The surgeon digs a channel through the pedicle using a free-hand technique, in order to insert a screw so that the spine can be mechanically straightened. A HAVE environment would ensure that training could be accomplished in a realistic manner with no risk to a patient. This proposal will develop the robotic actuators, control strategies, digital projection algorithms and audio capabilities to create a VR simulator which will be evaluated in conjunction with experts, fellows and residents at Sick Children’s Hospital. A longer term study will examine the feasibility of tele-collaboration between remote HAVE surgical simulators, which will allow the training of medical specialists in remote regions.

The anticipated outcomes will immediately increase the number of experts for scoliosis surgery. The technological advances in HAVE design are, however, relevant to many other medical training applications, since a HAVE can be reprogrammed entirely in software to look like any other procedure. The tele-collaboration capabilities could be very beneficial in our sparsely populated nation. Finally, there will be the training of HQP with interdisciplinary skills of computer graphics, audio processing, mechatronics and human factors.