Moneypenny: A speech-centric interface for drivers

The objective of this project was to design a speech-centric interface for a smartphone application that helps drivers communicate and stay up to date while driving. MoneyPenny is an application for Android using a natural language interface, serving as your “secretary”. Reading your e-mails to you or the news, or informing you about your appointments. Moneypenny was a project I worked on in September 2011. That is right before Apple introduced iPhone 4s with their implementation of Siri, and before Google Now – Android’s intelligent personal assistant – was released, so bear with me if you think that’s common sense and already done!

This project in keywords:

Requirements Analysis (target group, functionality, interaction style), Wizard of Oz, System overview (flowcharts), Android prototype implementation, prototype evaluation with users, video prototype.

What I did:

During the first phase of this project I took part in the brainstorming in order to come up with the requirements, define the target group and come up with a persona, define the specific functionalities that MoneyPenny should facilitate and last define the interaction style that would be implemented (instruction-based? dialogue-based? etc).

I also participated in the Wizard of Oz test, where I was mainly responsible for observing the participants and their behavior while driving in a simulator and trying to communicate with MoneyPenny.

My main responsibility in this project was to develop an Android application for MoneyPenny, implementing some of the decided functionalities ,like listening to the user and deciding what action should be performed, giving spoken confirmations etc. Nuance’s speech recognition SDK was used for that matter.

  

This slideshow requires JavaScript.

A demonstration of the Android application prototype for MoneyPenny

The video prototype for MoneyPenny

For:

Stan Ackerman’s Institute – User System Interaction, Eindhoven, The Netherlands

With:

In this project I worked with Paul Lehouck, Xinyu Ma, Hans Sandberg and Tanya Zavyalova.