The Utility of the SQLite Database for An Utterance Training Method Based On Lip Movements

Yuko Hoshino; Eiki Wakamatsu; Mitsuho Yamada

doi:10.52731/iee.v1.i1.4

Yuko Hoshino Tokai University
Eiki Wakamatsu Tokai University
Mitsuho Yamada Tokai University

DOI: https://doi.org/10.52731/iee.v1.i1.4

Keywords: utterance, training method, lip movements, database, SQLite, faceAPI.

Abstract

We previously proposed a utterance recognition system that uses the tracking and analysis of speakers' lip movements as words and sentences are uttered. In this report, we compared the lip movements in the SQLite database with those of utterances produced by students learning the method. We also built an utterance database from a group of text files of the utterances of Japanese TV announcers and native English speakers. We tested our system using the relational database management system SQLite for this training method.

References

Wakamatsu E, Hoshino Y, Yamada M. Proposal for an utterance training method based on lip movements. IMQA 2014 (The Seventh International Workshop on Image Media Quality and its Applications), September 2014, Chiba, Japan. pp. 44-47.

Hayamizu S, Takezawa T. Trends in research on multimodal information integration system. Trans Jpn Soc Artif Intell. 2006:13(2):206-211, Mar.1998. (in Japanese).

Nagata Y, Fujioka T, Abe M. Target signal detection system using two directional microphones. IEICE Trans A. 2000:J83-A(12):1445-1454. (in Japanese).

Yanagi T, Yamada M. Proposal and verification of lip movement model about utterance recognition interface without voice. HIS2008 (8th International Conference on Hybrid Intelligent Systems), Sept. 2008, p. 2422. (in Japanese)

Oda M, Ichinose S, Oda S. Development of a pronunciation practice CAI system based on lip reading techniques for deaf children. Technical Report of IEICE. 2007:107(179):53-58. (in Japanese)

Fukushima M. Easy training for a good voice. Seibido Publishing, Tokyo. 2006. (in Japanese).

Hirayama K. Dandelion. First Volume of Revised New National Language Two, Tokyo Shoseki, Jan. 1985. (in Japanese)

Three-month topic English-conversation. NHK publication, 2009. (in Japanese)

Hoshino Y, Consideration about the Database Storage to Manage Twitter Data, IMQA 2013 (The Sixth International Workshop on Image Media Quality and its Applications), September 2013, Tokyo, Japan. pp. 166-169.

Hoshino Y, Fujino I, Comparison between SQL and NoSQL using Twitter data, The 8th National Convention of Japan Personal Computer Application Technology Society, December 2013, Osaka, Japan, C2-3. (in Japanese)

public-domain SQLite Web Site, http://www.sqlite.org/