Jingjing Jiang

I am a second-year Ph.D. student at Nagoya University, advised by Prof. Ryuichiro Higashinaka.

My research interests lie in the dynamics of face-to-face human interaction and the development of natural human-agent interaction. During my master’s, I collected and analyzed multimodal face-to-face dialogue data, with a particular focus on its affective aspects.

My current research focuses on real-time multimodal human-agent interaction, particularly integrating talking-head generation with full-duplex spoken dialogue systems.

Email  /  GitHub  /  Google Scholar  /  LinkedIn

profile photo

Research

See my full publications on Google Scholar.

project image

Integrating Facial Generation into Full-Duplex Spoken Dialogue Systems


Jingjing Jiang, Atsumoto Ohashi, Ryuichiro Higashinaka
INTERSPEECH, 2026
paper

project image

Integrating Physiological, Speech, and Textual Information Toward Real-Time Recognition of Emotional Valence in Dialogue


Jingjing Jiang, Ao Guo, Ryuichiro Higashinaka
SIGDIAL, 2025
paper

project image

Towards a Japanese Full-duplex Spoken Dialogue System


Atsumoto Ohashi, Shinya Iizuka, Jingjing Jiang, Ryuichiro Higashinaka
INTERSPEECH, 2025
paper / code / website

project image

Estimating the Emotional Valence of Interlocutors Using Heterogeneous Sensors in Human-Human Dialogue


Jingjing Jiang, Ao Guo, Ryuichiro Higashinaka
SIGDIAL (Oral), 2024
paper


Experience

2025.11 – present

Research Assistant


National Institute of Informatics (NII)
Development of spoken dialogue models in the LLM-jp project

2023.06 – present

Research Assistant


Nagoya University Doctoral Program for World-leading Innovative & Smart Education
Lifestyle Revolution based on Transdisciplinary Mobility Innovation

2023.09 – 2023.11

Robot Competition 2023


Built a spoken dialogue system controlling a humanoid robot, generating context-appropriate expressions and motions from system utterances.


Source code from Jon Barron's website