The voice-activated lift won’t do Scottish! (Burnistoun S1E1 – ELEVEN!)

28 Jul

Voice recognition technology? …  In a lift? … In Scotland? … You ever TRIED voice recognition technology? It don’t do Scottish accents!

Today I found this little gem on Youtube and I thought I must share it, as apart from being hilarious, it says a thing or two about speech recognition and speech-activated applications. It’s all based on the urban myth that speech recognisers cannot understand regional accents, such as Scottish and Irish.

Scottish Elevator – Voice Recognition – ELEVEN!

(YouTube – Burnistoun – Series 1 , Episode 1 [ Part 1/3 ])

What? No Buttons?!

These two Scottish guys enter a lift somewhere in Scotland and find that there are no buttons for the floor selection, so they quickly realise it’s a “voice-activated elevator“, as the system calls itself. They want to go to the 11th floor and they first pronounce it the Scottish way:

/eh leh ven/

That doesn’t seem to work at all.

You need to try an American accent“, says one of them, so they try to mimic one, sadly very unsuccessfully:

/ee leh ven/

Then they try a quite funny, Cockney-like English accent:

/ä leh ven/

to no avail.

VUI Sin No. 1: Being condescending to your users

The system prompts them to “Please speak slowly and clearly“, which is exactly what they had been doing up to then in the first place! Instead, it should have said something along the lines of “I’m afraid I didn’t get that. Let’s try again.” and later “I’m really sorry, but I don’t seem to understand what you’re saying. Maybe you would like to try one more time?“. Of course, not having any buttons in the lift means that these guys could be stuck in there forever! That’s another fatal usability error: Both modalities, speech and button presses, should have been allowed to cater for different user groups (easy accents, tricky accents) and different use contexts (people who have got their hands full with carrier bags vs people who can press a button!).

I’m gonna teach you a lesson!

One of them tries to teach the system the Scottish accent: “I keep saying it until she understands Scottish!“, a very reasonable expectation, which would work particularly well with a speaker-dependent dictation system of the kind you’ve got on your PC, laptop or hand-held device. This speaker-independent one (‘cos you can’t really have your personal lift in each building you enter!) will take a bit more time to learn anything from a single conversation! It requires time analysing the recordings, their transcriptions and semantic interpretations, comparing what the system understood with what the user actually said and using those observations to tune the whole system. We are talking at least a week in most cases. They would die of dehydration and starvation by then!

VUI Sin No.2: Patronising your users until they explode

After a while, the system makes it worse by saying what no system should ever dare say to a user’s face: “Please state which floor you would like to go to in a clear and calm manner.” Patronising or what! The guys’ reaction is not surprising: “Why is it telling people to be calm?! .. cos Scottish people would be going out for MONTHS at it!“.

Well, that’s not actually true. These days off-the-shelf speech recognition software is optimised to work with most main accents in a language, yes, including Glaswegian! Millions of real-world utterances spoken by thousands of people with all possible accents in a language (and this for many different languages too) are used to statistically train the recognition software to work equally well with most of them and for most of the time. These utterances are collected from applications that are already live and running somewhere in the world for the corresponding language. The more real-world data available, the better the software can be tuned and the more accurate the recognition of “weird” pronunciations will be, even when you take the software out of the box.

VUI Best Practice: Tune your application to cater for YOUR user population

An additional safeguarding and optimising technique is tuning the pronunciations for a specific speech recognition application.  So when you already know that your system will be deployed in Scotland, you’d better add the Scottish pronunciation for each word explicitly in the recognition lexicon.  This includes manually adding /eh leh ven/ , as the standard /ee leh ven/ pronunciation is not likely to work very well. Given that applications are usually restricted to a specific domain anyway (selecting floors in a lift, getting your bank account balance, choosing departure and arrival train times etc.), this only needs to be done for the core words and phrases in your application, rather than the whole English, French, or Farsi language! So do not despair, there’s hope for freedom (of speech) even for the Scottish! :)

For a full transcript of the video, check out EnglishCentral.

About these ads

12 Responses to “The voice-activated lift won’t do Scottish! (Burnistoun S1E1 – ELEVEN!)”

  1. Craig W September 11, 2013 at 4:30 pm #

    I had a similar problem but with real people, trying to get my (fairly mild) Glasgow accent understood by some Indians I was doing business with. We were finally able to communicate when I mimicked an Indian accent. My (mainly English) colleagues were horrified and thought I was being racist – but I was just trying to be understood!

  2. Robbie Coull November 27, 2012 at 7:44 pm #

    Actually it’s an accurate description of North American voice recognition technology. I’m a Glaswegian who lived in Canada for a few years until last year and had to mimic an American accent to get anywhere with them. Out of around 100 attempts in Glaswegian I can’t remember ever getting a correct response.

    • Dr. Maria Aretoulaki November 28, 2012 at 1:08 am #

      Thanks for the confirmation Robbie! It must have been extremely frustrating for you!

  3. cecil grass August 25, 2010 at 2:35 pm #

    That is extremely funny! Fortunately I have seen that voice recognition software is better than that in general nowadays such as that used by Vocollect consultants. You can see it at http://go4sight.com/Practices/Vocollect.html and it works great despite the many accents I’ve seen it’s users speak with.

    • Dr. Maria Aretoulaki September 8, 2010 at 8:36 pm #

      I’m glad you agree that the video albeit hilarious is actually being unfair towards state-of-the art speech recognition software! :D

Trackbacks/Pingbacks

  1. 2012 in review – Not Bad! :) | VUI Design, Speech Recognition Apps & all that - April 13, 2013

    [...] The voice-activated lift won’t do Scottish! (Burnistoun S1E1 – ELEVEN!) 8 COMMENTS July 2010 [...]

  2. 2012 in review – Not Bad! :) « VUI Design, Speech Recognition Apps & all that - January 9, 2013

    [...] The voice-activated lift won’t do Scottish! (Burnistoun S1E1 – ELEVEN!) 8 COMMENTS July 2010 [...]

  3. TEDxManchester (13 Feb 2012): Voice Recognition FTW! « VUI Design, Speech Recognition Apps & all that - May 15, 2012

    [...] My TEDxManchester video hasn’t been uploaded yet, as it streamed copyrighted material from YouTube. So in the meantime, I am including the offending video here Burnistoun S1E1 – ELEVEN!  [...]

  4. 2010 in review – Not bad at all :) « VUI Design, Speech Recognition Apps & all that - January 3, 2011

    [...] The voice-activated lift won’t do Scottish! July 2010 4 comments 3 [...]

  5. Tweets that mention The voice-activated lift won’t do Scottish! « VUI Design, Speech Apps & all that -- Topsy.com - August 3, 2010

    [...] This post was mentioned on Twitter by DialogCONNECTION Ltd, VBVoice by Pronexus. VBVoice by Pronexus said: The voice-activated lift won’t do Scottish! Funny video #IVR http://ow.ly/2kkpk [...]

  6. Tweets that mention The voice-activated lift won’t do Scottish! « VUI Design, Speech Apps & all that -- Topsy.com - July 28, 2010

    [...] This post was mentioned on Twitter by DialogCONNECTION Ltd, DialogCONNECTION Ltd. DialogCONNECTION Ltd said: "The voice-activated lift won’t do Scottish!" http://bit.ly/9752yc or freedom (of speech) for Scotland! [...]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 367 other followers

%d bloggers like this: