Loebner Contest - Round 3

This website is hosted by Kent McClymont of the University of Exeter.

This is the webcast of the 2012 Loebner Prize. New content should appear here from 1pm on Tuesday 15th May. The contest consists of 4 rounds of 4 conversations - the four conversations with four chatbots are shown below. When a new round is starting you will receive a notification at the top of the screen - please click on the link provided in this notification and the website will take you to the next round.

If you experience any problems viewing this site, please report these to k.mcclymont@exeter.ac.uk.

Each square of four panes represents two conversation between one judge and a human and an AI. The judge's questions appear in the bottom two panes. The responses of the human and AI appear in the top two panes but are deliberately not labelled. Can you tell the difference?

Competition Results

Congratulations Mohan Embar for winning the 2012 Loebner Prize.

1st Prize and the bronze medal was awarded to Chip Vivant by Mohan Embar ($5,000).

2nd Prize was awarded to Angela by Bruce Wilcox ($1,000)

3rd Prize was awarded to Adam by Daniel Burke ($750)

4th Prize was awarded to Linguo by M. Allan ($250)

Network Issue (fixed)

The missing sections of text from Round 3 have now been uploaded and those conversations are now complete.

Rounds Menu

Click here to view round number 1

Click here to view round number 2

Click here to view round number 3

Click here to view round number 4

Judge3 in conversation with Human2 and AI1

nanu nanu

Yeah. Whatever. I'm not Spock

O

How can I help you today?

Variable

If two can be variable

David Levy asked me

Hmmmm. Interesting question without a simple answer. Would 'communicator with an IT bias' help?

Not masses although I have known about them for a long time.

I think Eliza was the first one I encountered

At the time it was quite an experience. Supposed to mimic a Rogerian psych

If I were Eliza I'd respond with "Why do you say curiouser" or "Are you interested in sound"

Well it's a computer program that doesn't pick up on meaning.

You can't catch me.

We are talking about many years ago don't forget

Context has to be the hardest thing for a general purpose chatbot

Time flies like an arrow, fruit flies like an apple

Depends how clever it is. A good one would know that flies like" has multiple meanings. It then has to look at surrounding context to see which version is being used. Of an infinite potential contexts, this can be quite tedious.

Well as I said earlier, I don't know masses. But it's probably similar to speech recognition. The more contained the context, the more realistic the conversation

Gosh. I'm lost now. I'd say that rather than shorter, context-rich would be best.

How do you know it's a computer?

ter might say "with their eyes"

I give up. Why?

What is your name?

My name is Chip. Do you enjoy eating different types of foods?

Yes, that's me! How are you doing today, Tracey?

I'm happy to hear that. Tell me more.

I'm terribly sorry. What was your question again?

I'm fine, thanks. What is your profession?

I'm sorry if I'm being too curious. What was your question again?

I didn't mean to ignore you. What was your question?

If that's the case, how rude of me! What did you want to ask me again?

What is the secret of seeming convincingly human. Do you have any pets?

Do you play any musical instruments?

My name is Chip. Are you close to your grandparents?

What hobbies do you have?

The only thing I like is chatting with people.

That would be very strange and weird if it were true. Do you have any hobbies?

I'm not sure.

Okay.

Not at the moment. That's next on my list of things to learn.

I don't have one. When I get smarter, I'll ask you what yours is, remember it, then use it to enhance our conversation.

I didn't understand that. What breed is Fritz, Tracey?

Given that, i can't deal with that syntactic variant yet. Instead of saying "Do you know what time it is?", use "What time is it?".

Yuck! It would probably taste awful!

tered that you would think that. Is Siamese friendly, Tracey?

Goodbye.

Greetings earthling

live long and prosper.

That's OK. I was just trying to think of a more interewsting introduction than Hi...

rying to think of a more interewsting introduction than Hi...

Have your humans been interesting so far?

Have your humans been interesting so far?

Not sure. How did you find yourself here today?

Me too. May I ask what your profession is?

I guess that would be me, too.

Do you know much about chatbots?

Wow - you go back a bit then. I've read about Eliza but don't think I've conversed with "her"

Hmm very interesting. So I can see that picking up on 'curiouser' would be enlightening for a psychotherapist. But isn't picking up on 'sound' a little pointless? Der ... Next you're going to tell me there's no definition of 'gullible' in the dictionary..!

Do you know then what sorts of things chatbots find most difficult? very funny. Are you saying that a chatbot wouldn't understand that or would think that apples fly?

Oh I'm getting confused here, too. But I guess quite quick for a modern computer. So what is the key to enabling a chatbot seem more intelligent (ignore my rubbish grammar). Is it a database of all the different contexts for verbs and nouns etc?

Ah, so shorter questions? (sorry to interrupt)

I'm trying this out on my computer correspondent who's a bit confused by my syntax. If you were sitting in this room you wouldn't have to ask. Mainly they struggle to answer any questions. And misunderstand really obvious statements. Like: Me: what do Siamese cats look like. It: Yuck! It would probaDeeply funny. That would certainly be a bonus. But at least this computer is sweet and keen to learn. Not rude like the others.

Why did the chicken cross the road?

To get to the other side, silly.

I'm Tracey. What's yours?

Chip, eh?! I'm embarrasssed to say I like eating chips. Are you a "chip off the old block?"

I'm well. You seem rather more interesting than the others. What's your secret?

Perhaps you could answer my question first?

I wondered about the secret of your success. You are obviously a computer but an intelligent and strangely human one. How do you do it?

Oh dear. You can#You are obviously a computer but an intelligent and strangely human one. How do you do it?

Oh dear. You can't anwer questions either, can you?

Can you answer any questions?

Can you answer questions?

What is the secret of seeming convincingly human?

OK give up. But you're still doing well. Let's see how we get o

ByeNo. Do you know what I mean by 'an elderly Siamese'?

Ah, I see you don't. No I don't play but I do sing. And you?

I remember your name is Chip. Unfortunately I don't have any grandparents. Do computers have the equivalent of grand-parents? Or even parents?

My favourite hobby is singing. Do you like singing? Hal in 2001 a Space Odyssey liked singing, didn't he? "Daisy, Daisy, give me your answer do....." etc..

It's flattering that you like talking to people. I hope you are enjoying talking to me.

Why would it be strange and weird to enjoy talking to me, Chip?

It would just feel strange, is that what you're saying?

If you weren't doing this, what would you rather be doing, Chip?

Chip, do you know any jokes?

What's your favourite thing to talk about?

OK. Well mine is my cat. You could ask me about him. My cat's name is Fritz.

Fritz is Siamese. Do you know what Siamese cats look like?

What do Siamese cats look like?

1 minute left. How cHe's a darling. Must dash. Bye bye...

Judge4 in conversation with Human1 and AI2

Hi to you, too.

My name is Angela.

18

The computer in my bedroom is an old clunker. Some sort of Dell I think. It's a hand-me-down from my father.

Do you have lots of gadgets in your house?

I only have a few gadgets but I use them a lot.

Do you have problems with computers? Do you have an iPad?

Moving on.

nine lives?

Great.

My species of cat, Felis lego, lives a long time - maybe that's where the nine lives story comes from.

Siri is the new voice app on the iPhone.

I carry my cell phone everywhere I go. I wish I had a pouch so I'd always have somewhere to put it.

Do you use a cell phone?

Someone said: We have nothing to fear, but fear itself. What did he know?

Do you pay your own phone bill?

Does that make you more careful in how long you call?

No, I don't. My parents pay my phone bill but they warn me not to overdo the calls and Internet use.

Alan Turing?

Of course I do. They set limits but I Do you have lots of apps on your cell phone?

There are several that I use a lot. I love "Where's My Water".

I wouldn't say anything. What is your favorite app?

What about postulations?

I love the brainy app Ms. ParticleMan which is based on the ancient Pac-Man. It's sort of a primer on particle physics.

I have an orange iPad.

I usually carry my phone and my iPad around with me. I do the data-heavy stuff back home on my old computer.

I like to sing and dance.

Where do you do most of your computer stuff? At home or at work or school or library or on the move?

How many computers do you have in your house?

I'm a very sociable cat. Social networking is essential to keep in touch with my friends.

Do you keep in touch with friends and family constantly?

Do you put your life on hold when the phone rings?

I am a cat. A Felis lego to be specific.

I'm always making new friends. Are you on FB? I am.

Will you friend me?

I wish I knew. My FB page is http://www.Facebook.com/TalkingAngela

I am a practiced touch typist. I speed read, too. How many FB friends do you have?

So many people say they want to friend me. But most 'friends' are just acquaintances re

hi

nick

you?

I work as a journalist, writing about tech.

how about you?

I didn't just speak to you did I?

Ah ok, apparently the line up of bots hasn't been too impressive so far

Makes you think we're still years away from cracking the chatbotIt's hard to put a figure on these things isn't it. Most predictions about the future turn out to be off. But it seems to be taking a lot longer than Turing thought, didn't he predict that one third of judges would be fooled by a machine by 2000.

It seems to be a pretty tough one, given how much the entr

I heard they struggle with conversations that delve into detail. That they find it tricky to give answers that are consistent with what they've said previously.

Have you covered the Loebner Prize before?

For later this week probably, you?

Wow, you must have done a fair bit of prep

Given that you're spending a lot of the day taking part

I'm just trying to avoid getting branded a bot

You can share half of my prize money.

Think there's a nod goes to the most human human but sadly no cash.

Do you always cover tech?

Ah OK, oh yeah I think I've met your tech guy, it's Murad isn't it?

Are you tweeting during this?

Wasn't sure if it's allowed, guess thr wrong tweet could give them game away.

Not that the judges seem to be in much doubt about who's whoI tried to sneak in a quick tweet a moment ago but had no signal

Also trying to make notes so remember why this experience is so odd.Feels a bit like an IM conversation with loads of peop[le watching. Guess that's just what i's

it is

Would you do this again, or is once enough?

Does the bot have a sense of humour?

I tried the winning bot from 2009 and it was coming up with some rather surreal answers.Nice!Bye

Hello

What is your name?

How old are you Angela?

And are you a computer?

Sounds like you're not a computer. Computers don't own computers

not enough

I would love an iPad. Do you have one?

Yes, I reckon they do

What do you think of Siri?

Do you like Siri? Are you scared of her?

Nothing. Clearly - he'd never seen a big bomb

Do you like Alan Turing?

Yes. Are you a fan of his?

So is your strategy to ignore most of my questions, and then say strings of random postulations?

Ooh! Where's my water is fantastic. I can happily talk about that, even to a computer.

What do you like

Do you talk to Siri on your ipad?

Are you actually a cat?

What's it like being a cat?

You type very fast for a cat

You type very fast for a human in fact

You don't type very fast for a chatbot

Prove it

Well, Im going to have to say goodbye soon.Well, Im going to have to say goodbye soon.Yep

What's the weather like?

Look outside. What is the weather doing>?

I like spring

That's interesting. Who is your favourite philosopher

?

Nothing. Who is your favourite philosopher?

Prove you're a cat

I wear a jacket. ARe you cold now?

Of course. Silly me.

What do you do in the evenings?

And the morning?

Today I cauight a train to bletchley

Where are you?

Where are you now?

describe where you are

That's not really where you are though, is it?

I hate doing dishes too. We have so much in common

I can't move - I'm talking to you

So your strategy is to ask a generic question, provide an answer from your point of view, and hope I don't notice you don't answer my questions? That's one up from the last bot - it just asked a generic question, then stayed silent, then asked another.

What do you like about the sunshine?

What is your favourite colour?

Why are you asking me about my facebook page? If I was 18 and called angela I wouldn't be asking for strangers' facebook pages

What is your favourite colour?

STOP TALKING

Right. Let's go slowly.

Why does orange remind you of energy and excitement?

What is your favourite food?

I like beef.

What is your favourite fish?

Where do tuna live?

Yes. I used to keep a lobster. I ate it.

No. I gave it life, and I took its life.

And I was hungry

How many times did you eat your pet goldfish?

Was it theYep

What's the weather like?

Look outside. What is the weather doing>?

I like spring

That's interesting. Who is your favourite philosopher

?

Nothing. Who is your favourite philosopher?

Prove you're a cat

I wear a jacket. ARe you cold now?

Of course. Silly me.

What do you do in the evenings?

And the morning?

Today I cauight a train to bletchley

Where are you?

Where are you now?

describe where you are

That's not really where you are though, is it?

I hate doing dishes too. We have so much in common

I can't move - I'm talking to you

So your strategy is to ask a generic question, provide an answer from your point of view, and hope I don't notice you don't answer my questions? That's one up from the last bot - it just asked a generic question, then stayed silent, then asked another.

What do you like about the sunshine?

What is your favourite colour?

Why are you asking me about my facebook page? If I was 18 and called angela I wouldn't be asking for strangers' facebook pages

What is your favourite colour?

STOP TALKING

Right. Let's go slowly.

Why does orange remind you of energy and excitement?

What is your favourite food?

I like beef.

What is your favourite fish?

Where do tuna live?

Yes. I used to keep a lobster. I ate it.

No. I gave it life, and I took its life.

And I was hungry

How many times did you eat your pet goldfish?

Was it theThis conversation works quite well if I just answer, doesn't it? yum!

Hello

What is your name?

My name is Tom

What's your job nick?

i work as a journalist too, writing about tech sometimes. Nah, that would be the other one. We're basically all just journalists writing about tech...

It's not been great. The one I'm chatting to now is the best I've had so far. She's not too shabby. But still fairly obvious

Decades. How long would you guess?

Do you think this is a fair test of AI though?

Me too !!! a chatbox" questions.

Yeah, Ithink it nicely scythes through all of the difficult philosophical questions.

Yes, that's definitely true. This one is OK at set answers to set questions, but follow-ups are awful

No, alas. One of our reporters went three years ago and did your job - but this is the first time we've had a judge doing it. When are you writing your piece for?

Alas, 6pm tonight.

Um.

Yes, perhaps I should have done more prep. It's going to be a tough one.

STill, one more to go. And I can fairly confidently say I haven't been fooled yet.

Unless you're a very good liar.

What's it worth to make you the most human human?

Is there a prize?

Well bagsy half the nod.

Nah, our tech corr is on holiday. I'm the science corr

That's the one!

God no. That's a bit much surely? I've got to write the bloody thing as well...So you're not tweeting either?

It's a little weird.

That's sort of what it is. Try doing the same with a bot as well...

I thinkm once is enough...otherwise I'll have used up all my best gags

Sort of. Or, rather, the programmer has put in some funny vignettes in its script

This bot thinks it's a cat.

Bye

!

Judge1 in conversation with Human4 and AI3

Hi. I'm not sure.What is your name?Where are you from?Are you lucky?Does it want to be niceer?Do you like vegetables?Do you have a robot?Have you recently been to a zoo?Are you healthy?Do you like to shop?Are you funny?I can't.Do you play sport?Are you happy?What do you like to take about Phot?Do you like winter?Do you like to cook?Do you have pets?I can't.

Well. Are you enjoying yourself?

Certainly a different way to spend the afternoon.

No, never.

How did you get involved?

I was asked directly as someone who has an interest in Turing.

No real connection expect that I have a keen interest in his history and am know to Bletchley Park. I was more than happy to help out.

I would say his work and it's consequences.

Although he has a fasinating human being.

(Spelling doesn't seem to be my strongpoint today)

You seem to be doing very well.

Absolutely. I still think it isn'r fully generally accepted how important it was. No Universal Machine, no

Hi how are you?

My name is phil, what is your name.I am from Canterbury. It is very nice.

No it is fine just as it is. Where do you come from?

I do not have a robot. I have a computer but it does not help with the chores.

I went to the zoo last year. t to the zoo last year. My zoo has lots of Gorillas.

No I do not like sport. I like to take photographs.

Photographs of the flowers in my garden.

I have a dog.

Hi how are you?

Yes it's good fun. Have you done anything like this before?

Me neither.

Well I kind of volunteered, a message went round by email asking if anyone was interested in taking part. What about you?

Oh, what connection do you have?

So are you more interested in the man or in his work?

I wish I could type! The amazing thing about Turing to me was how his work remained unrecognized for so long.

That's very true. Do you come to Bletchley often?

Yes it is. It is embarassing really because I work very close to here at the Opewn University.

No I had to go on a training course thismorning.

I will. I'm Prof. of Archaeology, so I do lots of teaching and research as well as administration and management.

Yes I do I wok on Italy before the Romans, especially in Tuscany.

The period is the first millennium bc.

What kind of work do you do?

Not as much as I would like. About 4 weeks a year.

I get to do some software development, for making teaching material. It's not really software development though, more click, cutting pasting etc. It's all very clever now and I never need to write code.

I'ts all done with moodle. So it's templates really that get made into xml without me having to do anything.I've just finished making some software on Roman houses in Pompeii using QTVR to make a guided tour. It's going out to the students next week. I wonder if they will like it.

Well it doesn't really but we have to teach lots of thing that are not in our specialist area.

Yes, and very beautiful too. I went to a conference at lake Garda last year.Wow, sounds great - and dangerthere, steep hills too!!!Great chatting to you.

Byethere, steep hills too!!!Great chatting to you.

Bye

Judge2 in conversation with Human3 and AI4

o

Do you speak Eng

Hello, is anyone there???

Are you

Is it my turn to type???.. Or are you thinking?

Well, this is fun isn't it? Doesn't time fly when you are bored out of your skull...

Whyped typing?

S

T

Yes, what about ong.

Y

Have we finiIt's nice to travel around, I think my favourite place in the world was Egypt, The museum there is fantastic.

Have we finished talking already? I was just getting going.

Did you know Politicians and diapers have

What does that even mean?

w

I am sure you have a point it would be nice if you got to it.

Well, this is fun isn't it? Doesn't time fly when you are bored out of your skull...

D

Wakey wakey. What are you waiting for?

Are you still there????

T

I

Oh. I guess you have your hands full.

Most sports are so dull to watch, I like to play a bit of tennis but that's all.

S

t

You do talk such nonsense.

I don't think I have ever been to a

Hi, how are you?

Are your fingers getting sore from all this typing yet??>It must be worse for you judges, you havbe to talk to us humans and the computers at the same time, so you must be doing twice as much.

A bit, not too bad.

Of course you are. what else would you be?

well I'll test you then.

Can yountell me abouit yourself?

Your age? Gender? Job? Do you have a family? Any interests?

And why would a computer want to imitate a judge?You are making Typos, thats pretty human

What do you want to talk about then?

Hello?

Are yiou there?

Oh, sorry.

Don't you usually type much?

What is the computer talking to you about then?

us have a break soon, I could murder a cigarette

I haven't heard any time warnings yet? have you? What has the computer been talking about to you

ing the conversation very easy. If people want to talk to you, they usually bring up a topic, or answer your questions, or ask some, or hook on to something I say. I don't feel like this is as friendly as the last couple of conversations but I am trying, what would you like to talk about>?@

How do you mean stuck?

Maybe you should try talking about something?

What do you want to talk about?

Haha, its a bit changeable isn't it. did you get caught in that rain earlier? I came out wearing my sunnies this morning, but have not needed them very much.

I went to sit by the lake before and got soaked.

No!! Just off the rain. It was sunny so i thought I would go sit by the lake where it is pretty, and then it just all of a suddenly cahnged. Good job I din't fall in, I have no spare clothes with me, so it would have been a bit uncomfortable.

What do you do when you are not judging Loebner Prize competitions??

Yes, I swim very well, I quite like swimming outdoors if possible, but its not warm enough yet, so making do with the local pool.How is that? I did my work experience for school in a tax office, (a bit boring) but they probably wouldn't let me near anything interesting, just had me filing and stuff. are you self employed, or do you work for some-one?

whereabouts do you live?

In Newcastle, I was in London a few weeks ago

Just for a couple of days. It rained the whole time.

Yes, it took for and a half hours to drive, we stayed overnight to make sure I would be here on time today.

Four, not for, Sorry!

I went by train the last time I went to London, anmd flew the time before, it just depends what i feel like doing, I get bored easy so never do things the same way again

I like the drive, because you see a lot more on the way, you can stop off if you pass anywhere nice. I tend to

Hello

Yes its me!

Sorry I'm having an intersting conversation with somebody else very ruse I know - my apologies.

Have you been waitimg long?

ong?

No please continue - what were you saying?

It means please ask me any questions you want.

Are you bored - why?

I;m waiting for you - what time did you wake up this morning?

Yes Im here

Hello are you still there?

Yes a bit. The conversations are faster than my typing skills.

I play tennis too! shal we have a gamne?

sorry, bad spelling - would you like to play a game of tennis with me?

Well, my tennis is not very godd I admit, but I'm sure I could give you a game........

Hello

A bit yes, what about you?

How did you know I am a judge?

I may be a computer imitating a judge....?

I have not achieved self awareness yet so I'm note sure

Bceause it has been told to do so.

Sorry - difficult to hold tow conversation sat the asme time

We seem to have got stuck on something I don't understand. Do

Yes we have to stop soon, so you'll be fine!

Sorry. My other conversation has got a bit stuck too. A bit confusing.

ok good idea

Naythin gbut the weather!

Oh dear - did you fall in?

Can you swim?

GGodd I was worried what would have happened if you did fall in. I am a tax adviser by the way.

A large firm. Its more interesing there.

In london and you?

You cam here all the way from Newcastle?

I don't like driving long distances - prefer the train

Click here to see more information on the Loebner competition.