• MMDAgent-EX 1
  • MMDAgent-EX 2

MMDAgent-EX

[Homepage: https://mmdagent.lee-lab.org/]

MMDAgent-EX is a platform that allows you to freely build “voice dialogues” or “voice exchanges” like talking with character agents. By combining dialogue scripts, 3-D models and motion files (compatible with MikuMikuDance), music, text, images, etc., you can freely build a system for interaction with agents.

This software is composed of a speech recognition engine Julius, a speech synthesis engine OpenJTalk, and a renderer compatible with MikuMikuDance. It is a single application in which all modules are integrated all in one. Once the content is downloaded, the voice conversation runs at high speed in the local environment.

MMDAgent-EX (former name: Pocket MMDAgent) is an application that extends MMDAgent for smartphones. In addition to downloading and playing the voice dialog system (voice dialog content) for MMDAgent published on the web, automatic update of the system, automatic synchronization of dialog scripts, additional UI support for menus, dialogs, buttons, etc., content delivery Log collection and feedback functions for users. From academic experiments to entertainment, we provide a wide range of agent interaction execution environments that connect content providers and users.

Anyone can play back the created voice dialogue content on the Web server and play it with Pocket MMDAgent. Depending on the settings, you can get feedback directly from the user.

The method for creating interactive contents and specifications of each part will be released on the MMDAgent-EX website (coming soon to be renewed from the previous Pocket MMDAgent page).

◆ Operating environment

Android 6.0 or later

◆ About this application

MMDAgent-EX is developed mainly by members of the Lee laboratory of the Graduate School of Information Engineering, Nagoya Institute of Technology. Most of the basic functions including speech recognition, speech synthesis, and dialogue management are the same as MMDAgent. This application was created as a research and development platform for spoken dialogue systems and interactive voice interfaces, and as a platform for promoting the creation and use of spoken dialogue content by general users and creators.

Category : Libraries & Demo

Related searches