music-ear-trainer-ios-ss

Ear Training with a Voice User Interface

As a musician and software developer, I look for synergies between these two roles.  One such example is the app that I’m developing for the purpose of helping musicians with ear training.  This app, named Music Ear Trainer, contains a voice user interface (VUI) that trains the user’s ear to recognize musical constructs such as intervals and triads.  If you have access to a Google Home device, you may invoke the app by saying “Hey Google, talk to Music Ear Trainer.”  The app will invite you into a conversation, playing intervals and triads for you to verbally identify.

The Music Ear Trainer app uses Actions on Google to implement its Google Assistant functionality.  I chose to use the API.AI tool to build my Assistant actions.  The following diagram contains a portion of the conversation flow design, consisting of constructs including contexts, intents, text responses, and webhooks.

ear-trainer-vui-intents-context-scripts-v3-cropped

Portion of Music Ear Trainer app conversation flow

The Music Ear Trainer app is licensed under Apache License Version  2.0, and is available in the ripped-ear-vui GitHub repository.  Please let me know if there is functionality you’d want to add to Music Ear Trainer, or if you have any questions about its implementation.

Regards,

James L. (Jim) Weaver

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s