Overview

Project preface of MMDAgent-EX.

What is MMDAgent-EX?

MMDAgent-EX is an experimental software platform for research, development and making fun of dialogue systems on mobile and cloud environment. You can play, create and share spoken dialog systems and voice interaction systems with MMDAgent-EX.

It is an extended version of MMDAgent that supports multiple OS, Web-based content sharing, excellent MMD compatibility, data logging facility with REST API / Apache Kafka, data encryption and many other improvements.

The goal of this project is to promote a baseline system that lets people to:

  • play various dialogue sytems more instantly,
  • create and share his own dialogue system freely,
  • connect dialogue system creators and users directly,
  • do social experiments of a dialogue system and collect data on research purpose.

What is the changes from original version?

Changes from the original version of MMDAgent is as follows:

  • Direct content download and automatic update
  • Recent speech API on iOS/Android (VoiceProcessingIO / AAudio)
  • Better downloaded content handling
  • Data collection and real-time interaction logging facility (REST API / Apache Kafka)
  • Better MMD compatibility, including PMX support
  • Tons of bug fixes and updates, works fine on mobile devices

All differences are fully listed in the Changes page.

Why do I want it?

MMDAgent-EX is good for people who:

  • want to exprience talking with agents in mobile device
  • is fun of a character and curious about creating your own talking agent
  • is studing dialogue system and want to collect data in a social experiments
  • has concern about next-era conversational user interface
  • feels it interesting to know concept of our “dialogue media content”
  • is a fun of MMD, and loves its platform
  • was once a lover of MMDAgent and expects more for its future

Is is not good for people who:

  • feel uncomfortable talking to a software human-like agent
  • does not like anime-style expression
  • can not stand speech processing errors
  • claims to be run on old devices (iOS < 9, Android < 6)

Where should I go next?

Go to the Getting Started section and follow the instruction for the first experience of MMDAgent-EX. The Key Bindings and Menu pages describe how to play with them.

If you want to edit or create your own content, first take a look at the System Overview, and learn the component of a dialogue content in the Content Overview page. The dialogue scenario is in a FST format, you can learn how to write FST scenario. More details of the file formats are described in File Formats section, including how to use PMX models in MMDAgent-EX.

You can make your content open on a Web site and let other people play with your content. See the How to Deploy pages how to do that.

When you want to do more for your content, the “HOWTO” page contains hints for creating your content, including introduction of many MMDAgent-EX functions.

For reference, All Messages and All Options in mdf are listed in a page.

MMDAgent-EX is based on original MMDAgent. To know MMDAgent-EX more, it is better to check the site of original MMDAgent project.



Last modified July 24, 2022: re-organized for more simplicity (a3ae1a9)