OTSUKA Kazuhiro

Affiliation

Faculty of Engineering, Division of Intelligent Systems Engineering

Job Title

Professor

Research Fields, Keywords

Communication Science, Multimodal Interaction, Social Signal Processing



Education 【 display / non-display

  • 2005.4
    -
    2007.3

    Nagoya University   Doctor Course   Completed

  • 1993.4
    -
    1995.3

    Yokohama National University   Electrical and Computer Engineering   Master Course   Completed

  • 1989.4
    -
    1993.3

    Yokohama National University   Division of Electrical and Computer Enginnering   Graduated

Degree 【 display / non-display

  • Doctor of Information Science - Nagoya University

  • Master of Engineering - Yokohama National University

Campus Career 【 display / non-display

  • 2024.10
     
     

    Duty   Yokohama National UniversityFaculty of Engineering   Division of Intelligent Systems Engineering   Professor  

  • 2020.4
    -
    2024.9

    Duty   Yokohama National UniversityFaculty of Engineering   Division of Intelligent Systems Engineering   Associate Professor  

External Career 【 display / non-display

  • 2012.10
    -
    2020.3

     

  • 2007.4
    -
    2012.9

     

  • 2003.4
    -
    2007.3

     

  • 2001.4
    -
    2003.3

     

  • 1999.12
    -
    2001.3

     

display all >>

Academic Society Affiliations 【 display / non-display

  • 2022.4
     
     
     

    The Japanese Society for Artificial Intelligence

  • 2005
     
     
     

    IEEE(Institute of Electrical and Electronics Engineering)

  • 1996
     
     
     

    電子情報通信学会

  • 1996
     
     
     

    情報処理学会

Research Areas 【 display / non-display

  • Informatics / Human interfaces and interactions

  • Informatics / Intelligent informatics

 

Thesis for a degree 【 display / non-display

  • 時系列画像に基づく動的事象の推測に関する研究

    大塚和弘

    2007.3

    Doctoral Thesis   Single Work  

Papers 【 display / non-display

  • Synergistic Functional Spectrum Analysis: A Framework for Exploring the Multifunctional Interplay Among Multimodal Nonverbal Behaviours in Conversations

    Mai Imamura, Ayane Tashiro, Shiro Kumano, Kazuhiro Otsuka

    IEEE Transactions on Affective Computing   16 ( 2 )   1056 - 1073   2024  [Reviewed]

    DOI Web of Science CiNii Research Repository

     More details

    Language:English   Publishing type:Research paper (scientific journal)   Publisher:Institute of Electrical and Electronics Engineers   Single Work  

    A novel framework named the synergistic functional spectrum analysis (sFSA) is proposed to explore the multifunctional interplay among multimodal nonverbal behaviours in human conversations. This study aims to reveal how multimodal nonverbal behaviours cooperatively perform communicative functions in conversations. To capture the intrinsic nature of nonverbal expressions, functional multiplicity, and interpretational ambiguity, e.g., a single head nod could imply listening, agreeing, or both, a novel concept named the functional spectrum, which is defined as the distribution of perceptual intensities of multiple functions by multiple observers, is introduced in the sFSA. Based on this concept, this paper presents functional spectrum corpora, which target 44 facial expression and 32 head movement functions. Then, spectrum decomposition is conducted to reduce the multimodal functional spectrum to a synergetic functional spectrum in a lower dimension functional space that is spanned by functional basis vectors representing primary and distinctive functionalities across multiple modalities. To that end, we propose a semiorthogonal nonnegative matrix factorization (SO-NMF) method, which assumes the additivity of multiple functions and aims to balance the distinctiveness and expressiveness of the factorization. The results confirm that some primary functional bases can be identified, which can be interpreted as the listener’s backchannel, thinking, and affirmative response functions, and the speaker’s thinking and addressing functions, and their positive emotion functions. In addition, regression models based on convolutional neural networks (CNNs) are presented to estimate the synergistic functional spectrum from the head poses and facial action units measured from conversation data. The results of these analyses and experiments confirm the potential of the sFSA and may lead to future extensions.

  • Unified Functional Spectrum Analysis: A Framework for Understanding Nonverbal Multimodal Multifunctional Interactions in Multiparty Conversations

    Tajima, M; Tamura, I; Sasaki, A; Otsuka, K

    IEEE ACCESS   14   47538 - 47559   2026.3  [Reviewed]

    DOI Web of Science

     More details

    Language:English   Publishing type:Research paper (scientific journal)   Joint Work  

  • Analysis and Estimation of Functional Relationship between Listener's Aizuchi and Head Nods in Conversations

    SUZUKI Sora, OTSUKA Kazuhiro

    JSAI Technical Report, SIG-SLUD   106 ( 0 )   33 - 40   2026.2

    DOI CiNii Research

     More details

    Language:Japanese   Publishing type:Research paper (research society, symposium materials, etc.)   Publisher:The Japanese Society for Artificial Intelligence   Joint Work  

  • Concept and Development of Nonverbal Functional Spectrum Analysis: How Can We Understand the Diverse Nonverbal Behaviors of Interlocutors?

    OTSUKA Kazuhiro

    JSAI Technical Report, SIG-SLUD   106 ( 0 )   32 - 32   2026.2  [Invited]

    DOI CiNii Research

     More details

    Language:Japanese   Publishing type:Research paper (research society, symposium materials, etc.)   Publisher:The Japanese Society for Artificial Intelligence   Single Work  

  • 自閉スペクトラム症児の会話における顔表情と頭部運動の非言語機能の特徴分析

    電子情報通信学会HCGシンポジウム2025

    電子情報通信学会HCGシンポジウム2025   2025.12

     More details

    Language:Japanese   Publishing type:Research paper (research society, symposium materials, etc.)   Single Work  

display all >>

Review Papers 【 display / non-display

  • 非言語情報が生み出すコミュニケーションのリアリティ

    大塚和弘

    NTT研究所発 触感コンテンツ専門誌ふるえ   8 ( 5 )   2016.12

     More details

    Language:Japanese   Publishing type:Article, review, commentary, editorial, etc. (other)   Single Work  

  • Prediction of "Who Will Be Next Speaker and When" in Multi-Party Meetings

    Ryo Ishii, Kazuhiro Otsuka, Shiro Kumano, Junji Yamato

    NTT Technical Review   13 ( 7 )   2015

     More details

    Language:English   Publishing type:Internal/External technical report, pre-print, etc.   Joint Work  

  • The Future of Idobata Kaigi (“Congregation at the Well”): Realizing Natural Conversations with Distance Access

    Kazuhiro Otsuka, Nobuhiro Furuyama, Mayumi Bono

    NII Today   48   6 - 7   2014.1

     More details

    Language:English   Publishing type:Internal/External technical report, pre-print, etc.   Joint Work  

  • 遠隔地間でも自然な会話を実現する、未来の井戸端会議とは

    大塚和弘,古山宣洋,坊農真弓

    国立情報学研究所 NII Today   62   6 - 7   2013.12

     More details

    Language:Japanese   Publishing type:Internal/External technical report, pre-print, etc.   Joint Work  

  • MM-Space: Recreating Multiparty Conversation Space by Using Dynamic Displays

    Kazuhiro Otsuka

    NTT Technical Review   10 ( 11 )   2012.11

     More details

    Language:English   Publishing type:Internal/External technical report, pre-print, etc.   Single Work  

display all >>

Awards 【 display / non-display

  • 特集テーマセッション賞(ソーシャル・インタラクション)

    2023.12   電子情報通信学会 HCGシンポジウム2023   複数モダリティの非言語情報に基づく対話者の視線機能の分析と認識

    Individual or group name of awards:田代絢子、今村まい、熊野史朗、大塚和弘

  • HCS研究会賞

    2022.1   電子情報通信学会 ヒューマンコミュニケーション基礎研究専門委員会   「対話中の非言語行動の機能スペクトラム解析に向けて〜頭部運動を対象とした機能コーパスと深層学習モデルの構築事例〜」

    Individual or group name of awards:大塚和弘

  • 特集テーマセッション賞

    2021.12   電子情報通信学会 HCGシンポジウム2021   複数人対話における深層転移学習による頭部運動相互作用の機能認識

    Individual or group name of awards:森 駿志, 大塚和弘

  • 情報処理学会論文誌ジャーナル特選論文賞

    2021.1   情報処理学会   話者継続・交替時における対話行為と視線行動に基づく共感スキルの推定

    Individual or group name of awards:石井 亮, 大塚和弘, 熊野史朗, 東中竜一郎, 青野裕司

  • 電子情報通信学会 HCGシンポジウム2018 特集テーマセッション賞

    2018.12   電子情報通信学会  

    Individual or group name of awards:石井 亮,大塚和弘,熊野史朗,東中竜一郎,富田準二

display all >>

Presentations 【 display / non-display

  • 対話中の頭部運動機能の解釈の曖昧性を推定する深層回帰モデルの検討

    武田 一輝, 大塚 和弘

    第21回情報科学技術フォーラム(FIT2022)  

     More details

    Event date: 2022.9

    Language:Japanese   Presentation type:Oral presentation (general)  

  • 複数人対話における深層転移学習による頭部運動相互作用の機能認識

    森 駿志, 大塚和弘

    電子情報通信学会HCGシンポジウム2021   2021.12  電子情報通信学会

     More details

    Event date: 2021.12

    Language:Japanese   Presentation type:Oral presentation (general)  

  • Prediction of Interlocutors’ Subjective Impressions Based on Functional Head-Movement Features in Group Meetings

    Shumepi Otsuchi, Yoko Ishii, Momoko Nakatani, Kazuhiro Otsuka

    23rd ACM International Conference on Multimodal Interaction (ICMI2021)  2021.10  ACM

    DOI

     More details

    Event date: 2021.10

    Language:English   Presentation type:Poster presentation  

    Venue:Montreal, Canada   Country:Canada  

  • Deep Transfer Learning for Recognizing Functional Interactions via Head Movements in Multiparty Conversations

    Takashi Mori, Kazuhiro Otsuka

    23rd ACM International Conference on Multimodal Interaction (ICMI2021)  2021.10  ACM

    DOI

     More details

    Event date: 2021.10

    Language:English   Presentation type:Poster presentation  

    Venue:Montreal, Canada   Country:Canada  

  • Inflation-Deflation Networks for Recognizing Head-Movement Functions in Face-to-Face Conversations

    Kazuki Takeda, Kazuhiro Otsuka

    23rd ACM International Conference on Multimodal Interaction (ICMI2021)  2021.10  ACM

    DOI

     More details

    Event date: 2021.10

    Language:English   Presentation type:Poster presentation  

    Venue:Montreal, Canada   Country:Canada  

display all >>

 

Charge of on-campus class subject 【 display / non-display

  • 2026   Practical System Design

    Graduate school of Engineering Science

  • 2026   Advanced information system Ⅱ-F

    Graduate school of Engineering Science

  • 2026   Advanced information system Ⅱ-S

    Graduate school of Engineering Science

  • 2026   Advanced information system I-F

    Graduate school of Engineering Science

  • 2026   Advanced information system I-S

    Graduate school of Engineering Science

display all >>

Charge of off-campus class subject 【 display / non-display

  • 画像ハンドリング工学

 

Committee Memberships 【 display / non-display

  • 情報処理学会 情報規格調査会

    2018.7 - 2020.3  専門委員

     More details

    Committee type:Academic society 

  • 電子情報通信学会 ヴァーバル・ノンヴァーバル・コミュニケーション研究会

    2016.4 - 2020.3  委員長

     More details

    Committee type:Academic society 

  • 電子情報通信学会 和文論文誌D編集委員会

    2010.5 - 2014.6  編集委員

     More details

    Committee type:Academic society 

  • 電子情報通信学会 ヴァーバル・ノンヴァーバル・コミュニケーション研究会

    2010.4 - 2016.3  副委員長(会計)

     More details

    Committee type:Academic society 

  • 電子情報通信学会 ヴァーバル・ノンヴァーバル・コミュニケーション研究会

    2008.4  専門委員,運営委員

     More details

    Committee type:Academic society 

display all >>