Do-Much-More Chatbot Wins 2009 Loebner Prize
'Do-Much-More' Chatbot Wins 2009 Loebner Prize for Computer Conversation
London - September 9th 2009
A computer 'chatbot' program called Do-Much-More has won the 2009 Loebner Prize competition, widely regarded as the World Championship for conversational software. The competition took place in Brighton, England, during the InterSpeech 2009 conference on speech technology which is currently in progress. Do-Much-More was developed by Dr. David Levy and his team at the London-based company Intelligent Toys Ltd. An earlier program won the Loebner Prize for Levy in New York in 1997, making him the only multiple winner who has a 100 per cent record in the event.
The Loebner Prize is an annual competition in artificial intelligence to find the chatbot considered by the judges to be the most human-like. The format of the competition is based on the Turing test, named after the famous British mathematician and computer pioneer Alan Turing who proposed the test in a 1950 paper entitled Computing Machinery and Intelligence. A human judge conducts conversations, via a computer keyboard, with a computer program and with a human being. Based on the responses the judge decides which is which, and in the Loebner Prize competition the judges rank each of their conversation partners from most humanlike to least humanlike. The computer program with the highest average ranking wins the competition and is awarded a medal and a cash prize (this year $3,000).
This annual prize was inaugurated in 1990 by Dr. Hugh Loebner in collaboration with the Cambridge Center for Behavioral Studies in Massachusetts, in order to encourage advances in human-computer conversation, an important topic in Artificial Intelligence. In Turing's 1950 paper he asked the question "Can a Machine Think?" He answered in the affirmative and raised a second crucial question: "If a computer could think, how could we tell?" Turing's suggestion was that, if the responses from the computer were indistinguishable from those of a human, the computer could be said to be thinking. He predicted that by the year 2000 "an average interrogator will not have more than a 70 percent chance of making the right identification after five minutes of questioning." In every round of the 2009 Loebner Prize competition each of four judges spent five minutes conversing with one of the chatbot programs and five minutes conversing with a human, thereby testing Turing's prediction.
None of the programs in Brighton managed to convince the judges that it was human but Do-Much-More came the closest, edging out two-time winner Rollo Carpenter of the UK who finished in second place.
Here are some excerpts from three of the judges' conversations with Do-Much-More. (The ~ symbol indicates that a judge used the backspace key.)
Do-Much-More and the Next Quantum Leap
The chatbot's name, Do-Much-More, owes its origins to the first well-known chatbot program 'Eliza', which was developed by Professor Joseph Weizenbaum at MIT in the early 1960s. Eliza was named after Eliza Dolittle in Shaw's play Pygmalion. David Levy called his first chatbot program Do-A-Lot (in contrast to 'Dolittle'), and when enhancing Do-A-Lot to create the current generation of the program he changed the name to Do-Much-More for obvious reasons.
The prize winning version of Do-Much-More is designed to respond with generalities, moving a conversation along in a lighthearted way without dealing with any details of a specific topic. As can be seen from the above excerpts from the 2009 Loebner Prize competition, it does this reasonably well.
The team at Intelligent Toys Ltd has already started on the next quantum leap in performance of their chatbot, employing a novel technique devised by Dr. Levy that will enable Do-Much-More to converse on any specified subject. Levy is convinced that there is a big market for such chatbots on corporate web sites. He says: 'Companies will find it very appealing when visitors to their web site can carry on conversations for as long as they wish about the company and its products.' Levy also sees a huge potential for the next generation of Do-Much-More for entertainment web sites: 'Imagine being able to chat to a virtual persona who is an Italian food freak, an avid Manchester United supporter or an expert on butterflies, . . . whatever subject you wish. The commercial potential is staggering.'
For more information please contact Dr. David Levy at Intelligent Toys Ltd.
Other articles filed under the Loebner Prize category.
- Bruce Wilcox Interview - Loebner 2010 winner
- Bruce Wilcox Interview - Loebner 2011 winner
- Chatbot Suzette Wins 20th Annual Loebner Prize, Fools One Judge
- Dr. David Levy Interview - Loebner 2009 winner
- Mohan Embar Interview - 2012 Loebner Prize Winner with Chip Vivant
- Rob Medeksza Interview - Loebner 2007 Winner
- Rollo Carpenter Interview - Loebner 2006 Winner
- Steve Worswick Interview - Loebner 2013 winner
- Robots Podcast #151: Big deals and privacy
by Tyler (Robotics News)
- Today at 05:00:13 AM
- RoboCop - Official Trailer #2
by Art (AI in Film and Literature.)
- March 09, 2014, 05:13:14 PM
- AI GRAPHIC NOVEL
by Art (AI in Film and Literature.)
- March 09, 2014, 01:03:10 AM
- What would a computer cook for dinner?
by Art (AI News )
- March 09, 2014, 12:51:39 AM
- To those who believe intelligence has been solved and only need more computers
by Art (AI Programming)
- March 09, 2014, 12:48:00 AM
- Just drink one small glass at home
by claude2 (Video)
- March 08, 2014, 09:43:54 PM
- Google glass could read your emotions - and send them to advertisers
by Tyler (AI News )
- March 08, 2014, 11:00:10 AM
- Computers used to 'see' neurons to better understand brain function
by Tyler (AI News )
- March 08, 2014, 05:00:38 AM
Most Online Today: 37. Most Online Ever: 208 (August 27, 2008, 08:36:30 AM)