Japanese

logo


1. Introduction    2. History of Waseda Talker Series     3. Mechanism     4. Demonstration of Talking Robot WT-7     5. Demonstration of Talking Robot WT-5 and WT-4


1. Introduction
conversation
 The purpose of this research is to clarify a human vocal mechanism from engineering viewpoints by reproducing the vocal movement using a talking robot, and to create the dynamic model. By using the mechanical talking robot, we could experiment human speech quantitatively. This model will lead to the production of cellular phones that can compress data by transmitting human vocal movement instead of human voices. Furthermore, the model will lead to developing medical training devices for vocally challenged people and learning devices for foreign languages.

Page Top


2. History of Waseda Talker Series

Introduction of WT Series(WT-1〜WT-3)

2-1. WT-4 (Waseda Talker No.4) (in 2004)

We developed a new anthropomorphic talking robot WT-4 (Waseda Talker No.4) that improved on WT-3. WT-4 had a human-like body to make the communication with a human more easily, and consisted of the total DOF was 19. We constructed an autonomous control method of WT-4 to mimic continuous human speech sounds by auditory feedback. In this method, the trajectory of each robot parameter was controlled so that the acoustic parameters (pitch, sound power, formant frequencies that are resonant frequencies of the vocal tract and have the peak of the output spectrum, and the timing of the switch between voiced and voiceless sounds) generated from the robot were close to those of human speech sounds.

2-2. WT-5 (Waseda Talker No.5) (in 2005)

We developed a new anthropomorphic talking robot WT-5 (Waseda Talker No.5). WT-5 consisted of 1-DOF lungs, 3DOF vocal cords and articulators (the 7-DOF tongue, 5-DOF lips, 1-DOF teeth, nasal cavity and 1-DOF soft palate), and could reproduce human-like articulatory motion; the total DOF was 18. We developed the mechanical lips and vocal cords with similar size and biomechanical structure to the human. We constructed an autonomous control method of WT-5 to mimic continuous human speech sounds including consonant sound by sensory and auditory feedback. In this method, we used tactile and intraoral pressure information to optimize the production of consonant sound. We also developed efficient optimization methods of auditory feedback by using speech recognition software.

2-3. WT-6 (Waseda Talker No.6) (in 2006)

We produced a new anthropomorphic talking robot WT-6 (Waseda Talker No.6). WT-6 consisted of 1-DOF lungs, 5-DOF vocal cords and articulators (the 5-DOF tongue, 4-DOF lips, 1-DOF jaw, nasal cavity and 1-DOF soft palate), and could reproduce human-like articulatory motion; the total DOF was 17. The length of the vocal tract is about 180[mm] and almost same as an adult male's. WT-6 has independent jaw opening/closing mechanism and three-dimensional tongue and vocal cavity made of thromoplastic rubber Septon (R) by Kuraray. The vocal cord model was also improved by adding new pitch control mechanism.


2-4. WT-7 (Waseda Talker No.7) (in 2007)

We developed a new anthropomorphic talking robot WT-7 (Waseda Talker No.7) mimicking human biological structure. WT-7 consisted of vocal organs (the 4-DOF vocal cords and 1-DOF lungs) and articulators (the 7-DOF tongue, 1-DOF velum, 5-DOF lips, and 1-DOF jaw), and could reproduce human- like articulatory motion; the total DOF was 19.Vocal cords, tongue and face were made of thermoplastic rubber Septon (R) by Kuraray. This material is so flexible and stretchable. Vocal cord model was also improved by adding new pitch control mechanism. By adopting a new linkage mechanism, the tongue model could form 3D vocal tract shape more accurately than the previous 2D model.

    

Page Top



3. Mechanism
The flow from the lungs generates a sound by vibrating the vocal cords. The articulators (teeth, lips, teeth, nasal cavity and soft palate) change the sound. 

WT-7 (Section) Vibration of WT-5's Vocal Cords
(High-Speed Camera/1000[fps])

Page Top


4. Demonstration of Talking Robot WT-7
   Click the following pictures and see the Talking Robot movie.

   aiueo(WT-7)
   MPEG 1.35 MB
Page Top



 
5. Demonstration of Talking Robot WT-5 and WT-4
   Click the following pictures and see the Talking Robot movie.
Human Vocal Mimicry
aiueo(WT-5)
MPEG 1.49 MB
sasisuseso(WT-5)
MPEG 1.40 MB
papipupepo(WT-5)
MPEG 1.19 MB
Human Vocal Mimicry
"hassei" (WT-4)

MPEG 0.92 MB

Page Top


Acknowledgement
  This research has been supported by Grant-in-Aid for Scientific Research (KAKENHI). We would like to express our thanks to all co-researchers ,Kuraray Co, Ltd. ATR, Okino Industries, Ltd., Chukoh Chemical Industries, LTD. and SolidWorks Japan K. K. for helping us to develop the robot's hardware.
Page Top


Relation
Japan Science and Technology Agency (JST)
Core Research for Evolutional Science and Technology (CREST)
"Creating the Brain" Research Project"Task Planning Mechanism of Speech Motor Control"

SolidWorks Japan K.K.

ATR
Okino INDUSTRIES
Chukoh Chemical Industries, LTD.
Kuraray Co, Ltd   Septon
Honda Lab (Waseda University)
Page Top


Papers of Talking Robot


Back to Top of Takanishi Lab.