Works/研究

Attention-based interaction/注意に基づくインタラクション

本サブグループでは人間の注意に基づいたインタラクションの研究をしております。
Our subgroup researches attention-based interaction.

対話エージェントの対話相手や周辺環境の状況認識技術の開発
Research and development for the technology of the conversational agent that can recognize a person who talks with the agent and the environment around the person.

対話エージェントが実環境において人と対話するためには、対話相手や環境の状況を認識し、その情報を元に対話を構成する必要があります。そのために、私たちは対話相手の行動や属性、環境内で起きたイベントを認識するための状況認識技術の開発を進めています。対話エージェントの振る舞いを状況によって変えるために、様々なカメラやセンサの入力から人の三次元位置情報や性別・年代などの属性を認識する技術、人をリアルタイムにトラッキングしそれぞれの行動・対話履歴を把握する技術の研究を行っています。

A conversational agent should recognize a person’s actions, the person’s attributes and the environment around the person because the agent talks with the person. Thus, we develop the recognition technology for the person’s actions, the person’s attributes, and the event in the environment around the person. We research about recognizing the person’s 3D position and the person’s attributes such as the apparent biological sex and age with various sensors like a camera because we make the agent change the agent’s action autonomously in various situations. Our research in position tracking in real-time can memorize dialogue histories and actions.


出版物

[1] Yuki Okafuji, Yasunori Ozaki, Jun Baba, Asano Kitahara, Junya Nakanishi, Kohei Ogawa, Yuichiro Yoshikawa, Hiroshi Ishiguro, “Please Listen to Me: How to Make Passersby Stop by a Humanoid Robot in a Shopping Mall,” HRI (LBR) , 2020
[2] Yuki Okafuji, Yasunori Ozaki, Jun Baba, Junya Nakanishi, Kohei Ogawa, Yuichiro Yoshikawa, Hiroshi Ishiguro, “Behavioral assessment of a humanoid robot when attracting pedestrians in a mall,” arXiv, 2021
[3] Yuki Tamaru, Yasunori Ozaki, Yuki Okafuji, Jun Baba, Junya Nakanishi, Yuichiro Yoshikawa, “3D Head-Position Prediction in First-Person View by Considering Head Pose for Human-Robot Eye Contact,” arXiv, 2021
[4] Yuki Okafuji, Yasunori Ozaki, Jun Baba, Junya Nakanishi, Kohei Ogawa, Yuichiro Yoshikawa, Hiroshi Ishiguro, “Behavioral assessment of a humanoid robot when attracting pedestrians in a mall” arXiv, 2021
[5]Taichi Sakaguchi,Yuki Okafuji,Kohei Matsumura,Jun Baba,Junya Nakanishi “An Estimation Framework for Passerby Engagement Interacting with Social Robots” arXiv, 2022

おすすめ