扇情的な鏡 / Incendiary reflection

About

Do all of your emotions really come from inside ?
Incendiary reflection aims to create computer-generated emotion by letting people recognize pseudo-generated facial expressions as changes to their own facial expressions. This artwork influences your emotional state by reflecting your facial expression as a slightly different one. Although you are not changing your facial expression, your face in the mirror looks like happy or sad. What someone sees in the mirror is her/himself. However, if one could see his/her face smiling in the mirror, then one unconsciously recognize the changing in mirror as one's actual body changing, one might also become happier.

Incendiary reflection consists of a camera, and a display. The camera is used to capture and track a user's face. This system gives feedback of a deformed facial expression by using a mirror-like display. We developed a method for deforming a user’s face and transforming a user’s facial expression in real time, using an image-processing technique [Schaefer et al. 2006]. Using this method, we easily and naturally deformed the appearance of a user’s face. We generated two facial expressions—Smiley Face” and Sad Face”—which represent the positive-negative affect dimension. Furthermore, we conducted a user study to evaluate the effectiveness of deformed facial feedback. Our results showed that this type of feedback could change emotional states; not only positive affect and negative affect but also preference decision [Yoshida et al. 2013]. This suggested that we could artificially manipulate emotional states.

Credits

Planning and Development: Shigeo Yoshida

Planning Support: Hiroshi Ishiguro, Michitaka Hirose, Takuji Narumi and Sho Sakurai

Development Support: Toki Katsumura, Yuki Ban and Naoto Nakazato

Support: IPA Exploratory IT Human Resources Project (The MITOH Program)

Publications & Awards

吉田成朗、鳴海拓志、櫻井翔、谷川智洋、廣瀬通孝：リアルタイムな表情変形フィードバックによる感情体験の操作、ヒューマンインタフェース学会論文誌、Vol.17 No.1、2015年2月https://doi.org/10.11184/his.17.1_15 ヒューマンインタフェース学会論文賞

Good Design Award, 2013年10月1日 [link]

Innovative Technologies, 2013年9月10日 [link]

Shigeo Yoshida, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2013. Incendiary reflection: evoking emotion through deformed facial feedback. In ACM SIGGRAPH 2013 Emerging Technologies (SIGGRAPH ’13). Association for Computing Machinery, New York, NY, USA, Article 8, 1. https://doi.org/10.1145/2503368.2503376 (ACM Author-Izer)

Shigeo Yoshida, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2013. Incendiary reflection: evoking emotion through deformed facial feedback. In ACM SIGGRAPH 2013 Talks (SIGGRAPH ’13). Association for Computing Machinery, New York, NY, USA, Article 35, 1. https://doi.org/10.1145/2504459.2504503 (ACM Author-Izer)

IPA（独立行政法人情報処理推進機構）未踏 2012年度採択プロジェクトスーパークリエータ認定, 2013年4月30日 [link] [link]

Shigeo Yoshida, Tomohiro Tanikawa, Sho Sakurai, Michitaka Hirose, and Takuji Narumi. 2013. Manipulation of an emotional experience by real-time deformed facial feedback. In Proceedings of the 4th Augmented Human International Conference (AH ’13). Association for Computing Machinery, New York, NY, USA, 35–42. https://doi.org/10.1145/2459236.2459243 (ACM Author-Izer)