The paper presents a new data acquisition system that can collect visual and tactile signals with spatial and temporal consistency. This is in response to the need for spatial-temporal alignment of visual-tactile data in VR applications, a need that has grown with the development of VR technology and the emergence of the metaverse concept. The researchers developed a VR-based application called V-Touching that uses the dataset generated by the new system to provide joint visual-tactile perception with distinct vibrotactile feedback when interacting with objects in a virtual environment.
Publication date: 29 Dec 2023
Project Page: https://github.com/wmtlab/Pixel2Taxel
Paper: https://arxiv.org/pdf/2312.16391
