24 multivisions display visualization of the data.

12 Vicon cameras around the studio wall track users' location, movement, and gesture and then, the sonification system generates speech, music, and sounds in real-time based on those tracking data. Taking embodied cognition and interactive sonification into account, we have developed an immersive interactive sonification platform, 'iISop' at Immersive Visualization Studio (IVS) at Michigan Tech.

Immersive Interactive Sonification Platform Sangwon Lee in CS and Zach Duer in Visual Arts, supported by the Institute for Creativity, Arts, and Technology (ICAT). This project is conducted in collaboration with Dr. Through user studies to confirm if our approach improves Also, we anticipate that the audience members’Ĭontrol over their POV will enhance their agency in Person view will improve the bystanders’ engagement and Use the apparatus like a camera viewfinder to freely moveĪnd see the virtual world through and control their viewpointĪs active spectators. We use the motion tracking system to create a virtualĬamera in VR and map the apparatus’ physical location The bystanders to see the VR environment through a tablet We have developed a physical apparatus for VR headset user and their experience from a third person The bystanders in the VR-based interactive media, we proposeĪ technique with which the bystanders can see the However, the bystandersĬannot have a holistic view this way. In practice, a secondary screen is provided to bystandersĪnd shows what the VR user is seeing. Synchronizing headsets can be costly and cumbersome. Having a VR-headset for every bystander and However, VR-based interactive media are oftenĬonsumed in a solitary set-up and cannot be shared in social That enables live, immersive aesthetics for interactive Virtual reality (VR) is an emerging technology of artistic expression Further, vibrotactile feedback improved the levels of presence and engagement more clearly. We observed that hand tracking enhanced the user’s sense of presence, engagement, usability, and task performance. We also developed a device that delivers vibrotactile feedback at the user’s fingertips while hands are tracked by a built-in camera on a VR headset. The objective of the game is to obtain the highest score by hitting the buttons as accurately as possible with the music. We investigated the sense of presence, engagement, usability, and objective task performance under three different conditions: (1) VR controllers, (2) hand tracking without vibrotactile feedback, and (3) hand tracking with vibrotactile feedback. In this project, we explored the effects of interaction methods and vibrotactile feedback on the user’s experience in a VR game. Hand tracking-based interaction provides a natural and intuitive experience, consistency with real world interactions, and freedom from burdensome hardware, resulting in a more immersive user experience.

However, hand tracking technology and head mounted displays (HMDs) with a built-in camera enable gesture-based interactions to be a main method in VR applications these days. Currently, controllers are the primary interaction method in most VR applications, by indirectly manipulating virtually rendered hands in VR with buttons or triggers. In addition to haptic feedback, interaction methods are another aspect that impacts on user experience in the VE. Delivering haptic feedback in virtual environments (VEs) is one approach to provide engaging and immersive experiences. Providing an immersive experience to the virtual reality (VR) user has been a long-cherished wish for HCI researchers and developers for decades.

Viewfinder virtual reality