Songle
|
PodCastle
|
VocaListener
|
VocaWatcher
|
I am a Prime Senior Researcher and the Leader of the Media Interaction Group (Senior Research Scientist until March 31, 2009), Information Technology Research Institute (ITRI) at the National Institute of Advanced Industrial Science and Technology (AIST), which is a newborn Japanese public research organization that is set up on April 1st, 2001 and combines 15 research institutes, including the former Electrotechnical Laboratory (ETL) where I worked from April 1st, 1998 to March 31st, 2001.
I have served concurrently as a Researcher of Precursory Research for Embryonic Science and Technology (PRESTO) ("Information and Human Activity" research area), Japan Science and Technology Corporation (JST) from October 1st, 2000 to September 30th, 2003, an Associate Professor (Cooperative Graduate School Program) of the Department of Intelligent Interaction Technologies, Graduate School of Systems and Information Engineering, University of Tsukuba since April 1st, 2005, a Visiting Professor of the Speech and Music Information Research Group, Research Innovation Center, The Institute of Statistical Mathematics since April 1st, 2008 (Visiting Associate Professor until March 31, 2009), and a Project Manager of the MITOH Program (the Exploratory IT Human Resources Project) by the Information Technology Promotion Agency (IPA) since May 1st, 2009.
I received a B.E. degree in Electronics and Communication Engineering in 1993, an M.E. degree in Electrical Engineering in 1995, and a Doctor of Engineering degree in Electronics, Information and Communication Engineering in 1998, all from Waseda University (Muraoka Laboratory). I received 31 awards, including the Commendation for Science and Technology by the Minister of MEXT "Young Scientists' Prize", DoCoMo Mobile Science Awards "Excellence Award in Fundamental Science", IPSJ Nagao Special Researcher Award, and IPSJ Best Paper Award.
Professional Activities / History of Attending International Conferences / Reports on the Media
Visiting Researchers and Internship Students
An invited article "Crowdsourcing-Based Web Services for Speech and Music" (Masataka Goto) about PodCastle and Songle was published in the IEEE ComSoc (Communications Society) MMTC (Multimedia Communications Technical Committee) E-Letter (Industrial Column: Special Issue On "Crowdsourcing-based Multimedia Systems", Vol.8, No.1, pp.23-26, January 2013).
I was invited to give a keynote talk entitled "PodCastle and Songle: Crowdsourcing-Based Web Services for Spoken Content Retrieval and Active Music Listening" at the International ACM Workshop on Crowdsourcing for Multimedia (CrowdMM 2012) on October 29th, 2012. I was also invited to participate in a "Panel Discussion" as a panelist on October 29th, 2012.
I was invited to give a keynote talk entitled "PodCastle and Songle: Web Services for Retrieval and Browsing of Speech and Music Content on the Basis of Automatic Content Analysis and Crowdsourcing" at the International Workshop on Search Computing of CHORUS+ Network of Audio-Visual Media Search on September 26th, 2012. I was also invited to participate in a "Concluding Panel on the Future of Search" as a panelist on September 26th, 2012.
Presentation Video:
I organized a special session "Frontiers of Singing Information Processing" as an event of the 94th IPSJ SIGMUS Meeting on February 3rd, 2012.
Our five-year research project "Building a Similarity-aware Information Environment for a Content-Symbiotic Society" (Research Director: Masataka Goto (AIST)) was accepted in the research area "Creation of Human-Harmonized Information Technology for Convivial Society" of the CREST (Core Research for Evolutional Science & Technology) funding program provided by JST (Japan Science and Technology Agency). The project will run for five years from October 1, 2011 to March 31, 2017 with a focus on music information research. We will do our best to make important academic and social contributions.
This project is named "OngaCREST Project".
I was invited to give a talk on VocaListener and "Music Listening in the Future" at an experimental concert "Strange Voice" by an artist "Maywa Denki" on July 26th, 2011.
Yamaha Corporation, on June 8th, 2011, announced that our VocaListener will be released as a commercial product (VOCALOID Job Plugin) for VOCALOID3.
Our VocaListener and VocaWatcher are reported on a Japanese television program NHK Science ZERO on February 5th, 2011. I also appeared as a guest speaker in the studio.
Media Coverage:
I was invited to give a lecture on music information processing at AIST Science Cafe in Caffe Berger (Tsukuba, Ibaraki, Japan) on October 27th, 2010.
We exhibited a singing humanoid robot "HRP-4C Miim" based on VocaListener (singing-to-singing synthesis system) and VocaWatcher (natural singing motion generator for a humanoid robot) at the CEATEC JAPAN 2010 (Makuhari Messe) from October 5th to 9th, 2010.
[2010/10/05]
Exhibitions (Demonstrations):
Media Coverage:
I organized a special session "Frontiers of Singing Information Processing" as an event of the 86th IPSJ SIGMUS Meeting on July 28th, 2010.
An invited review article "Music Informatics" was published in the IPSJ (Information Processing Society of Japan) Magazine (Vol.51, No.6, pp.661-668, June 2010).
A series of our music information research was reported in an article entitled "Music Listening in the Future" on the Japanese magazine "TV Bros. (the TV magazine of the future)" (No.593, p.86, June 9th, 2010).
I was invited to give a keynote address entitled "Music Listening in the Future" at the 128th AES Convention in London (AES London 2010) on May 22nd, 2010. I was also invited to participate in the workshop "Interacting with Semantic Audio" as a panelist on May 24th, 2010.
Press Release:
Media Coverage:
I was interviewd by the Japanese Society for Artificial Intelligence. Its article in Japanese was published in the Journal of the Japanese Society for Artificial Intelligence (Vol.25, No.1, pp.164-168, January 2010).
Our research project on PodCastle was reported in an article on the Japanese magazine "NIKKEI PERSONAL COMPUTING" (p.117, March 22nd, 2010).
At the 50th Anniversary National Convention of Information Processing Society of Japan, I organized a two-hour special session on CGM (Consumer Generated Media) with the focus on "Miku Hatsune", "NICO NICO DOUGA", and "PIAPRO" at the University of Tokyo on March 10th, 2010. There were invited talks and a panel discussion by Hideki Kenmochi (Yamaha Corporation), Hiroyuki Itoh (Crypton Future Media, Inc.), Akihiko Koizuka (Dwango Co., Ltd.), and Satoshi Hamano (Nihon Gigei, Inc.) This special session was reported on a lot of online new sites.
Our research project on the interactive generation of dance video clips was given the "WISS 2009 So-net Award: Gold Award" at the 17th Workshop on Interactive Systems and Software (WISS 2009) on December 3rd, 2009.
A series of our music information research was reported in an article on the Japanese magazine "RIKEI NAVI" (pp.18-19, October 19th, 2009).
We organized the ISMIR 2009 (10th International Society for Music Information Retrieval Conference) that was held in Kobe, Japan from October 26th to 30th, 2009 (General Chairs: Masataka Goto and Ichiro Fujinaga). We had 308 participants from 29 countries. Thank you all for your contributions to the conference!
As satellite events after ISMIR 2009, we also organized the CrestMuse Workshop 2009 at Kyoto University on October 31th, 2009 and the Special SIGMUS Symposium at the University of Tokyo on November 2nd, 2009 to share the state-of-the-art research activities with ISMIR participants and Japanese researchers.
I was given the IPSJ (Information Processing Society of Japan) Nagao Special Researcher Award from the IPSJ on May 29th, 2009.
Starting from May 1st, 2009, I serve concurrently as a Project Manager of the MITOH YOUTH Program (the Exploratory IT Human Resources Project) by the Information Technology Promotion Agency (IPA), Japan.
I was given The Young Scientists' Prize, The Commendation for Science and Technology by the Minister of Education, Culture, Sports, Science and Technology on April 15th, 2008.
I was given DoCoMo Mobile Science Awards ``Excellence Award in Fundamental Science'' on October 19th, 2007.
We are pleased to announce that ISMIR 2009 (The Tenth International Society for Music Information Retrieval Conference) will be held in Kobe, Japan (General Chairs: Masataka Goto and Ichiro Fujinaga). It will be held from October 26th to 30th.
Our paper "SmartMusicKIOSK: Music Listening Station with Chorus-Search Function" published in Transactions of Information Processing Society of Japan (IPSJ) was given the IPSJ Best Paper Award on May 20, 2005. I wish to express my gratitude to those who have supported this project.
I began serving concurrently as an associate professor (cooperative graduate school program) of the Department of Intelligent Interaction Technologies, Graduate School of Systems and Information Engineering, University of Tsukuba on April 1st, 2005.
An invited review article "Recent studies on music information processing" (HTML version) was published in the journal "Acoustical Science and Technology" (Vol.25, No.6, pp.419-425, November 2004).
My research project on "SmartMusicKIOSK: Music Listening Station with Chorus-Search Function" was reported on the on-line news sites of Nature and American Institute of Physics.
Reports on Newspaper, Television, and Magazine:
My research project on "SmartMusicKIOSK: Music Listening Station with Chorus-Search Function" was reported in the morning edition of the Japanese daily newspaper "Nihon Keizai Shimbun" on August 1, 2003, and in the Japanese newspaper "Nikkei Ryutsu Shimbun (Nikkei Marketing Journal)" on September 9, 2003.
Reports on Newspaper, Television, and Magazine:
Our paper "SmartMusicKIOSK: Music Listening Station with Chorus-Search Function" presented in the Japanese symposium "Interaction 2003" of the IPSJ (The Information Processing Society of Japan) was given the Best Paper Award on February 27, 2003. I wish to express my gratitude to those who have supported this project, especially to Hideki Asoh (National Institute of Advanced Industrial Science and Technology) for his valuable discussions.
Reports on Newspaper, Television, and Magazine:
List of Research Projects (Including Collaborative Research)