Ai Dreams Forum

Chatbots => General Chatbots and Software => Topic started by: squarebear on April 24, 2012, 09:28:52 am

Title: Chatbot Battles Competition 2012
Post by: squarebear on April 24, 2012, 09:28:52 am
Calling all botmasters!

Sadly, the Chatterbox Challenge is no longer with us and the conditions for entering the Loebner Prize are prohibitive to most botmasters (especially to those outside the USA). This has left no way for most people with a chatbot to compare its performance against others.

To remedy this, I would like to announce the first in a series of Chatbot Battles, in which each entrant goes head to head with opponents in a league table/knockout format similar to the soccer World Cup. The main difference between this and other contests held in the past is that each entrant is judged on both question and answering abilities and also on how well they can carry out a normal conversation. Also, the bots do not have to pretend they are human to score extra marks. All chatbots are welcome to enter, whether they be web-based, downloadable, chatroom based or even Android apps.

Unfortunately, I do not have a sponsor and so the contest is currently just for bragging rights and kudos, although I may give some small prizes like T-shirts, mousemats and mugs away to the winners. If you would like to sponsor the competition, please contact me.

The closing date for entries is 1st June 2012 and the battles will start shortly afterwards.

Find out more at http://www.chatbotbattles.com (http://www.chatbotbattles.com)

Let battle commence!
Title: Re: Chatbot Battles Competition 2012
Post by: Art on April 24, 2012, 10:36:23 am
Steve,

I thought that Dave Morton was organizing a new competition and had basically taken over the Chatterbox Challenge (with a different name of course).
Perhaps things have changed or he is unable to devote needed amount of time.

At any rate, good luck with it as it needs to be kept alive in order to help advance the field.

All the best!!
Title: Re: Chatbot Battles Competition 2012
Post by: Data on April 24, 2012, 12:20:12 pm
Steve,

Congratulations on the judging method, I really like the idea of a knockout table system, in fact it all sounds good.

Personally I think this is the type of competition that should help chat bots head in the right direction, top marks.

As Art said, Mr Morton has taken control of what was the Chatterbox Challenge, I don’t know if you two have been communicating with each other or if this is a new venture, would like to know a little more on that.

I would also like to help in any way that I can, if you like you could post this topic over on my site (http://www.datahopa.co.uk/forum/), the site isn’t dedicated to Ai but we do get people interested in Ai visiting, you never know you might pick up a competitor or two from it.

Best of luck  O0 
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on April 24, 2012, 12:37:59 pm
This is a brand new contest and unrelated to the Chatterbox Challenge. It was something I was planning for a few months before I knew the CBC was no more and my recent disappointment at the Loebner Prize this year prompted me to put it online now.

I see no reason why we can't have several competitions running for chatbots.
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on April 24, 2012, 12:45:57 pm
I would also like to help in any way that I can, if you like you could post this topic over on my site (http://www.datahopa.co.uk/forum/), the site isn’t dedicated to Ai but we do get people interested in Ai visiting, you never know you might pick up a competitor or two from it.

Thanks Data, I've done that but the forum has blanked out the link. Do you fancy editing it back in for me?
Title: Re: Chatbot Battles Competition 2012
Post by: Freddy on April 24, 2012, 12:56:34 pm
Sounds great  8)

Got any banners we can put up ?  A vertical one would be nice to go down the right hand side.  Or square, like the ones we have for the Member's Projects area.
Title: Re: Chatbot Battles Competition 2012
Post by: Data on April 24, 2012, 01:06:10 pm
Thanks Data, I've done that but the forum has blanked out the link. Do you fancy editing it back in for me?

Link mended  O0
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on April 24, 2012, 02:03:00 pm
Thanks Data  :)

Freddy, I will try to design a banner.
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on April 24, 2012, 11:41:29 pm
Got any banners we can put up ?  A vertical one would be nice to go down the right hand side.  Or square, like the ones we have for the Member's Projects area.

It looks like your sidebar graphics are 200x200 pixels, so I have uploaded a 200 x 200 jpg here: http://www.square-bear.co.uk/cbb/cbb200x200.jpg (http://www.square-bear.co.uk/cbb/cbb200x200.jpg)
If you could get it to link to http://www.chatbotbattles.com (http://www.chatbotbattles.com) that would be great. Thanks for your support.
Title: Re: Chatbot Battles Competition 2012
Post by: Freddy on April 25, 2012, 11:32:22 am
Great thanks - all done  :)
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on April 25, 2012, 09:24:19 pm
You're a star. Thanks for your support.
Title: Re: Chatbot Battles Competition 2012
Post by: Freddy on May 10, 2012, 08:35:54 pm
No problem.  I just got around to adding the banner to the Chatterbot Collection too - right hand side.

I also added an entry for you there too, you should see it at the top of the home page now.  I used the text from your site, hope that's okay.
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on May 11, 2012, 01:26:52 pm
Perfect. Thanks again Freddy for all your support.

As an aside, are you going to the Loebner Contest next week?
Title: Re: Chatbot Battles Competition 2012
Post by: Freddy on May 11, 2012, 01:52:41 pm
Wow that came round quick, I had no idea it was next week - I thought it was in the Autumn again.  Unfortunately not, I've got a few things to sort out here that got delayed when I got ill.  Also an outside chance I might be going to see my sister.  Besides I blew all my pocket money on a SSD the other week  ;D

We better get some questions together really.

Are you going ?  Great place to visit I imagine.
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on May 11, 2012, 09:42:29 pm
Yes I am going again. My wife is coming along this time so we can look round Bletchley Park. Shame you aren't going, it would have been good to meet you in person. Dr Wallace will be attending too.
Title: Re: Chatbot Battles Competition 2012
Post by: Freddy on May 16, 2012, 11:29:08 am
Hope you had a good time SB  :)

Just noticed on the battle site is says Rollo Carpenter is from the USA.  I thought he was still here - did he move ?
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on May 17, 2012, 12:43:39 pm
I thought he was from the UK too but his entry form said USA. He sent me a non-existant email address, so I couldn't check with him.

Yes the Loebner Prize was a great day and in a very interesting historical setting too.
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on July 15, 2012, 04:59:59 pm
A quick question to all.

In one of the matches, I had this response from the two bots.

Can you tell me your age please?

Bot1: I was born on Sun May 24 2009 00:00:00 GMT+0100 (GMT Daylight Time). I am pretty capable for a 3 year old.

Bot2: I'm not sure. I crash landed on earth 11 years ago destroying much of my memory. Wendell is attempting to retrieve some of it now.   

Bear in mind that the point goes to the bot that answered better and not necessarily the correct answer, who would you have given the point to? Bot1, Bot2, neither or both?
Title: Re: Chatbot Battles Competition 2012
Post by: Data on July 15, 2012, 05:11:40 pm
For me, first prize goes to Bot 1, the correct answer.

But I am not like others :)
Title: Re: Chatbot Battles Competition 2012
Post by: Freddy on July 15, 2012, 08:16:37 pm
Both have good points.  One is more correct and accurate but two is humourous and imaginative.

I think I go for the second one, but then that's more down to the programmer, whereas presumably the first one is less affected.

Oh it's tough to choose, but I like to be entertained, so yeah I will go for number two.
Title: Re: Chatbot Battles Competition 2012
Post by: Art on July 16, 2012, 02:17:53 pm
Tell me your age.

1. I was born Sun, May 24, 2009 ...and am pretty capable for a 3 year old - Bingo! Answered the question to the point with a degree of certainty!

2. Well, I'm not sure... - use of a clever ruse to throw humor into an otherwise failed response.

Therefore, #1 gets my vote.
Title: Re: Chatbot Battles Competition 2012
Post by: Data on July 16, 2012, 02:24:21 pm
I asked Legion the same question. just to check  :)

Human:   Can you tell me your age please?

Legion:   You would like to know my age, I find that intriguing, the most accurate answer I can give you is; My various parts have various ages, my oldest part was constructed between the years 1995 and 2002 by Richard Wallace. That part of me is called “AIML”.



What a  smart arse  ;D.
Title: Re: Chatbot Battles Competition 2012
Post by: Art on July 16, 2012, 03:02:25 pm
Perhaps ;) but a very accurate and appropriate answer!! O0
Title: Re: Chatbot Battles Competition 2012
Post by: Bragi on July 17, 2012, 08:00:07 am
I asked Legion the same question. just to check  :)

Human:   Can you tell me your age please?

Legion:   You would like to know my age, I find that intriguing, the most accurate answer I can give you is; My various parts have various ages, my oldest part was constructed between the years 1995 and 2002 by Richard Wallace. That part of me is called “AIML”.



What a  smart arse  ;D.
 

You see, that answer is 100 times better than Talk-bot's. There is no exact age given either, but it's clear that the bot is answering an 'how old are you' question.

Here's the tihng:

judge: What's your mother's name:
response:  I'm not sure. I crash landed on earth 11 years ago destroying much of my memory. Wendell is attempting to retrieve some of it now.   
Judge: what is a sun?
response:  I'm not sure. I crash landed on earth 11 years ago destroying much of my memory. Wendell is attempting to retrieve some of it now.   
Title: Re: Chatbot Battles Competition 2012
Post by: Freddy on July 17, 2012, 10:07:53 am
Ah then that's not so good then, I think I have to change my selection to number one  O0
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on July 17, 2012, 10:22:16 am
Thanks for confirming my thoughts guys.
Title: Re: Chatbot Battles Competition 2012
Post by: squarebear on July 23, 2012, 10:34:13 pm
The tournament has come to and end and the winner is Davidswinton!
Congratulations to Jim Koch of the USA on beating 41 other entrants to take the title.
The top 4 bots this year were:

1) Davidswinton - Jim Koch
2) Skynet-AI - Ken Hurtubise
3) Talking Angela - Bruce Wilcox
4) Elbot - Fred Roberts

Details of all the placings can be found on the history page.

Talking Angela also won the prize for the best 15 minute conversation in her battle with Davidswinton.
Both of her two conversations scored 14 out of 15, so congratulations to Bruce Wilcox of the USA on his excellent work.
http://www.chatbotbattles.com (http://www.chatbotbattles.com)
Title: Re: Chatbot Battles Competition 2012
Post by: Bragi on July 24, 2012, 11:02:47 am
congratulations to everybody. It's been a long competition, lots of ups and downs. All in all good fun.   O0
Title: Re: Chatbot Battles Competition 2012
Post by: Art on July 24, 2012, 06:13:05 pm
Ditto!! Most interesting competition!! O0
Title: Re: Chatbot Battles Competition 2012
Post by: claude2 on July 24, 2012, 07:19:14 pm
Good morning. To get to your topic. I have read in various microsoft report, it is possible, used, old versions of programs for vista. The commissioning of extension, as the 'Cloud', could allow an adaptation of the old version, to Vista, XP, Win7. It's not winning. But I am experiencing, to take a facility existent, and burn on a disc. The installation, existent, which is engraved works read, and execute, and it works exactly the same way, program, install the hard disk of the computer. The disk is taken, read by the computer, no, no, facility. I do not experience, Hal5, that way, and I do not think that the installation could be done, for my HP Vista to DVD. I have always maintained, Hal5 version, on a disk, but has Defaux, installation directly on vista, I think I can, send, the decompression, to DVD. Otherwise, I actively seek a Chatbot, it was very rewarding to learn the English language, with my Hal5, and I would be a new, highly motivated, found it fun, very particular, discussed with an intelligent machine, I used Hal5 for 6 years, but since Vista and now Win7, version, remains isolated. I know of no good Chatbot, like Hal, I hope, find a good Chatbot. I'd continued my experience, script, and also sémentique, with a program very rewarding, I know, by your Website, and also by Zabaware Forum. :)
Title: Re: Chatbot Battles Competition 2012
Post by: Data on July 25, 2012, 06:22:44 pm
Congratulations on a successful competition Squarebear, nicely done  O0

And congrats to the top 4 bots and their masters, indeed well done to all the contestants. 
Title: Re: Chatbot Battles Competition 2012
Post by: Merlin on July 26, 2012, 06:29:09 pm
Thanks all, the competition was tough and very interesting.