Profile
Third-year Ph.D. student. Born and raised in Osaka, Japan. I play the guitar. My research focuses on sound effect synthesis.
Memberships
- Acoustical Society of Japan (ASJ), Student Member
- Information Processing Society of Japan (IPSJ), Student Member; Special Interest Group on Music and Computer (SIGMUS)
- IEEE Student Member
Project
PronounSE
I am conducting research on technologies for synthesizing sound effects. Sound effects are frequently used in media productions such as films and video games to enhance scenes. Creating sound effects typically requires knowledge, experience, creativity, and technical skills. However, even individuals without such expertise can often imagine the desired sound and imitate it to some extent using their voice. Therefore, my research focuses on a sound effect synthesis method that uses generative deep learning to reflect the nuances of vocal mimicry of sound effects. For more detail, please see below.
Publications
Journal Articles
- Riki Takizawa, Shigeyuki Hirai, Asako Kanezaki, and Hitoshi Suda, Sound effect synthesis from language-independent mimicry: a case study on explosion sounds, APSIPA Transactions on Signal and Information Processing, Vol. 15, No. 1, pp. 464–488, 2026.
Datasets & Code
-
PronounSE dataset (Zenodo)
DOI: 10.5281/zenodo.20283840 - PronounSE source code (GitHub)
Conference Presentations
- Riki Takizawa, Shigeyuki Hirai, and Hitoshi Suda, A study of sound effect synthesis from vocal mimicry using sound effect metadata as semantic features, 2026 Autumn Meeting of the Acoustical Society of Japan, 1-R-36, poster presentation, 2026. Paper
- Riki Takizawa, Shigeyuki Hirai, and Hitoshi Suda, Evaluation of a sound production method using sound effect synthesis from vocal mimicry: a user study with professional sound creators, Entertainment Computing 2026, oral presentation, 2026.
- Riki Takizawa, Shigeyuki Hirai, and Hitoshi Suda, Evaluation of a sound production method using sound effect synthesis from vocal mimicry: adding sound effects to video by novice sound creators, Proceedings of Interaction 2026, pp. 90–99, oral and demo presentations, 2026.
- 滝沢 力, 平井 重行, 金崎 朝子, 須田 仁志, 言語非依存な口真似による効果音合成手法 PronounSEの評価, 情報処理学会研究報告 2025-MUS-143(51), pp.1-7, 2025.
- 滝沢 力, 平井 重行, 口真似からの爆発音合成とその主観評価および定量評価, 第27回 日本音響学会 関西支部 若手研究者交流研究発表会, 2024.
- Riki Takizawa and Shigeyuki Hirai, PronounSE: SFX Synthesizer from Language-Independent Vocal Mimic Representation, Adjunct Proceedings of ACM UIST2024, Article No. 21, 2024.
- 滝沢 力, 平井 重行, 言語非依存な口真似データセット構築と口真似のみからのTransformerによる効果音合成, 日本音響学会第152回研究発表会,3-6-2, 2024.
- 滝沢 力, 平井 重行, 複数話者の擬音的発話音声データセットによる効果音合成の試み, 情報処理学会研究報告 2024-MUS-140(5), pp.1-7, 2024.
- 滝沢 力, 平井 重行, 擬音的発話音声からの効果音合成とその深層学習手法の改良, 情報処理学会第86回全国大会講演論文集, 1R-03, 2024.
- 滝沢 力, 平井 重行, 擬音的発話のニュアンスを反映するインタラクティブ効果音合成, 情報処理学会インタラクション2024, インタラクティブ発表 1B-34, 2024.
- 平井 重行, 滝沢 力, 生成系AIを活用した効果音制作手法の研究, CEDEC2023 ショートセッション, 2023.
- 平井 重行, 滝沢 力, Transformerを用いた効果音合成技術 -爆発音を対象に-, CEDEC2023 インタラクティブセッション I-9, 2023.
- Riki Takizawa and Shigeyuki Hirai, Synthesis of Explosion Sounds from Utterance Voice of Onomatopoeia using Transformer, Companion Proceedings of ACM IUI2023, pp.87-90, 2023.
- 滝沢 力, 平井 重行, 音韻と韻律を含めたオノマトペ音声からのTransformerによる爆発音合成, WISS2022論文集, デモ発表 2-B06, 2022.
- 滝沢 力, 平井 重行, Transformerによるオノマトペ音声から爆発音への変換の試み, 第25回 日本音響学会 関西支部 若手研究者交流研究発表会, 2022.
- 滝沢 力, 平井 重行, Transformerを用いたオノマトペ音声からの爆発音合成の試み, 情報処理学会研究報告 2022-MUS-134, No.55, 2022.
Academic Service
- Organizer, XACLE Challenge 2026 (ICASSP 2026 Grand Challenge)
Exhibitions
- XR Kaigi 2025: PronounSE exhibition, Dec. 2025.
- Inter BEE 2025 — INTER BEE IGNITION × DCEXPO: PronounSE booth exhibition, Nov. 19–21, 2025.
Press / Appearances
- 【CEDEC2023】画像生成AIでサウンドも生成できちゃう? メルスペクトログラム画像を利用した効果音生成手法 GameBusiness.jp (2023/8/29掲載)
- 「ポケモン」環境音の作り方から疑似もぐもぐまで。ゲームサウンドの新世界, AV Watch (2023/8/28掲載)
Academic Background
- Apr. 2024 - Present : Doctoral Program, Department of Frontier Informatics, Graduate School of Kyoto Sangyo University
- Apr. 2022 - Mar. 2024 : Master's Program, Department of Frontier Informatics, Graduate School of Kyoto Sangyo University
- Apr. 2018 - Mar. 2022 : Faculty of Information Science and Engineering, Kyoto Sangyo University
- Apr. 2015 - Mar. 2018 : Osaka High School
Awards and Research Funding
- Selected for the Content Technology Innovation Program (CTIP) 2025: PronounSE
- Excellent Presentation Award, Otogaku symposium 2025
- 29th Student Outstanding Presentation Award, Acoustical Society of Japan
- Kakusei Project 2024 Accepted
- JST Support for Pioneering Research Initiated by the Next Generation
- TeamLab Award, WISS 2022
Work Experience
- July. 2024 - Present : Research Assistant, Intelligent Media Processing Research Team, Artificial Intelligence Research Center, National Institute of Advanced Industrial Science and Technology (AIST), Japan.
- Apr. 2024 - Present : Research Assistant, Kyoto Sangyo University
- Jun. 2023 - Feb. 2025 : Part-time Job, Generic Solution Co., Ltd
- Jun. 2022 - Sep. 2022 : Part-time Job, Ernie MLG Inc
- Apr. 2022 - Mar. 2024 : Teaching Assistant, Kyoto Sangyo University
