FaceShare: Mirroring with Pseudo-Smile Enriches Video Chat Communications
About
FaceShare is a videophone system, which can augment the remote-communication by generating a pseudo-smile. When FaceShare detects that the partner is smiling, it starts to deform the user's face into a smile. We implemented a prototype videophone system which can deform the user's face into a smile in response to their partners' smiling. A 3D camera is used to capture an image of the user's face and detect the feature points and the intensity of the user's smiling. The deformed user's image is generated and fed to a video stream, and the partner's smile intensity can be obtained in real time between browsers via WebRTC. We conducted an experiment in which pairs of participants had brief conversations via FaceShare. The result implied that FaceShare enhances the mimicker's feeling of closeness toward the mimickee, and improves the subjective smoothness of a conversation for both the mimicker and the mimickee.
Publications
鈴木啓太, 横山正典, 吉田成朗, 望月崇由, 布引純史, 鳴海拓志, 谷川智洋, 廣瀬通孝：同調的な表情変形技術を用いた遠隔コミュニケーションの拡張, 情報処理学会論文誌, Vol.59 No.1, 2017年
Keita Suzuki, Masanori Yokoyama, Shigeo Yoshida, Takayoshi Mochizuki, Tomohiro Yamada, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. FaceShare: Mirroring with Pseudo-Smile Enriches Video Chat Communications. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5313–5317. https://doi.org/10.1145/3025453.3025574 (ACM Author-Izer)
鈴木啓太, 横山正典, 吉田成朗, 木下由貴, 望月崇由, 山田智広, 櫻井翔, 鳴海拓志, 谷川智洋, 廣瀬通孝: 同調的な表情変形技術を用いたコミュニケーション拡張に関する提案, 第21回日本バーチャルリアリティ学会大会 (VRSJ2016), 2016年9月