Force Feedback and Virtual Reality

One of the challenges in computational structural biology is to enable the efficient use and inter-operation of a diverse set of techniques to simulate, analyze, model, and visualize the complex architecture and interactions of macromolecular systems. Our latest development effort will permit scientists to build models, combine atomic and volumetric data, and perform morphing and warping (flexible docking) interactively within a single computational environment. We are developing a 3D graphics extension for Situs, termed 'Sculptor', that is capable of supporting virtual reality (VR) devices such as stereo glasses, 3D trackers, and force-feedback (haptic) devices. (see Figure). A force feedback device measures a user's hand position and exerts a precisely controlled force on the hand. Our software supports this by calculating forces according to the correlation coefficient of density maps and crystallographic data. The high sampling frequency required for force feedback (refresh rate > 1kHz) is achieved by means of the vector quantization algorithm developed in our group that reduces the complexity of the data representation to manageable levels.

In addition to automated fitting, microscopists have a need to evaluate and manipulate docking models interactively "by eye". 3D capabilities and the "physics of touch" offer tangible benefits for modelers who wish to explore a variety of docking situations in a VR environment.

Interactive rendering of a microtubule data set in an immersive VR environment with Sculptor (left). The platform-independent, OpenGL-based graphics library supporting the software was developed in collaboration with Forschungszentrum Jülich, Germany. EM- and molecule-specific data interfaces and a Phantom 6-DOF force-feedback device (right) are implemented in the Houston lab.

References

Main Page