Computer that "Learns" how to play a game...

  • 12 Replies
  • 4036 Views
*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Computer that "Learns" how to play a game...
« on: September 22, 2012, 01:34:35 am »
...Then learns how to play it even better once it get the chance to read the game manual!!

Cool article at:
http://www.ripten.com/2011/07/13/mit-ai-computer-teaches-itself-english-to-play-civilization-v-skynet-is-pleased/
In the world of AI, it's the thought that counts!

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Computer that "Learns" how to play a game...
« Reply #1 on: September 23, 2012, 01:50:39 pm »
Interesting though a bit lacking in detail.  So they just showed the computer the manual and it read it.  How for example did it understand, did they have to teach it English first ?  I'm guessing it's a bit more hand fed than they let on.  Just not enough to go on here.  Thanks though  O0

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: Computer that "Learns" how to play a game...
« Reply #2 on: September 24, 2012, 02:31:54 am »
Freddy, the article indicated: MIT decided to develop an AI that was essentially thrown into a game of Civilization with virtually no instructions on the game’s tasks or on the language that the game was written in. Creepily enough, after some trial-and-error, the AI began winning the games 46% of the time. Feeling that 46% wasn’t good enough, the MIT guys decided to give the AI the manual to the game.

...an AI that can think and rationalize its way through a videogame. The AI then began winning the game 79% of the time.

I think it said quite a lot about the AI they developed. ^-^
In the world of AI, it's the thought that counts!

*

Data

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1279
  • Overclocked // Undervolted
    • Datahopa - Share your thoughts ideas and creations
Re: Computer that "Learns" how to play a game...
« Reply #3 on: September 24, 2012, 11:08:00 am »
Yes interesting, the Ai managed to learn and then make good use of what it learned, doesn’t sound much but to my mind it is.

For sure a step in the right direction.   

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Computer that "Learns" how to play a game...
« Reply #4 on: September 24, 2012, 12:15:10 pm »
Yeah I am with you Art, but just how much did they help it out.  You just don't write some code and have it suddenly understand English - Chatbot developers have been trying this for years, it's the holy grail.  If it was that remarkable how come it hasn't made the news headlines ?  If it's that advanced then this is not something trivial - all I want is more information...

*

victorshulist

  • Trusty Member
  • ****
  • Electric Dreamer
  • *
  • 118
Re: Computer that "Learns" how to play a game...
« Reply #5 on: September 24, 2012, 04:14:32 pm »
I don't think this lives up to the hype either.

From : http://web.mit.edu/newsoffice/2011/language-from-games-0712.html


So initially, its behavior is almost totally random. But as it takes various actions, different words appear on screen, and it can look for instances of those words in the instruction set. It can also search the surrounding text for associated words, and develop hypotheses about what actions those words correspond to. Hypotheses that consistently lead to good results are given greater credence, while those that consistently lead to bad results are discarded.

 
Ok so a classification type system.     This series of actions , with this degree of probability , could relate to this action word.

Semi interesting ... but they make it sound like it understands the totality of a phrase or sentence as a whole.  Which I very very much doubt...  being an article from July 2011. ..I think if it was as they portray, it would beat a Turing Test.

Good article and nice approach though.  This work will feed into a larger Natural Language Understanding system, but probably won't be the central piece.

When we can ask it questions about the manual it read, then we can say it has understanding.  Anyway my two cents :)
« Last Edit: September 24, 2012, 05:31:13 pm by victorshulist »

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: Computer that "Learns" how to play a game...
« Reply #6 on: September 25, 2012, 11:23:56 am »
@Freddy,
One problem is that this event is NOT noteworthy as an event like say Kim Kardashian visiting Paris or London or some interesting place. It is not something that garners the attention and acclaim of the general public. People are nosy when it comes to other people and those events...not what a machine does or can do.
Watson is all but forgotten in spite of that accomplishment. People are only entertained for the moment, then they quickly move on.

@ Victor,
I think their experiment speaks greatly in line with their original goal and it performed its task better that expected. I don't recall their project even being geared toward competing in a Turing Test nor is their success the same as a Turing Test. Perhaps with proper coding, it could.

You see, you both are typical examples of how complacent we, as a society have become. We are USED to having machines around us in practically every aspect of our lives, computers, smart devices, robots, etc. So a computer can play chess and GO and run households and adjust inventories, etc., it is not as big a deal as it once was. It is no longer MAGIC! (to paraphrase Arthur C. Clark)  Aside from some abject trickery by lesser known individuals I would have to side with the success of the researchers at MIT, a quite prestigious institution, not given to hype or inflating their own ego.

Sometimes we simply have to take things for face value...for what they are. In the same framework, I'd certainly like to know more about this program and its potential applications. Just my thoughts....
In the world of AI, it's the thought that counts!

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Computer that "Learns" how to play a game...
« Reply #7 on: September 25, 2012, 12:54:06 pm »
Yes you are right, this kind of thing is not media worthy most of the time - but Rollo Carpenter made the news here in the UK on a couple of channels when he won the Loebner prize so I do hold some hope.

I wouldn't say I was being complacent about this - I was in fact challenging it and not accepting it at face value...  I'm not sure where you got that from, perhaps I phrased things incorrectly.

Peace  ;)

*

victorshulist

  • Trusty Member
  • ****
  • Electric Dreamer
  • *
  • 118
Re: Computer that "Learns" how to play a game...
« Reply #8 on: September 25, 2012, 02:49:06 pm »
  I think the confusion here, as usual, stems from different people's ideas of what the word 'understanding' means, the conceptions we each have, and the expectations we have of a machine that claims to have it.

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: Computer that "Learns" how to play a game...
« Reply #9 on: September 27, 2012, 01:46:26 am »
Yes guys, please forgive my wrong choice of wording as I should have said that you have become accustomed to or used to various forms of AI. Complacent was simply a wrong choice for me. English being my second language. MY first one was as an infant with goos and gahs! :)

On the contrary you both are always looking for ways to improve and seek refinements in the field of AI and interaction with your projects and your peers.

Again...my bad...sorry!!
 :-[
In the world of AI, it's the thought that counts!

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Computer that "Learns" how to play a game...
« Reply #10 on: September 27, 2012, 12:38:51 pm »
No problem at all Art, I think we all knew what angles we were each coming at and were respecting our individual views.  It's all good :)

*

victorshulist

  • Trusty Member
  • ****
  • Electric Dreamer
  • *
  • 118
Re: Computer that "Learns" how to play a game...
« Reply #11 on: September 28, 2012, 01:48:08 pm »
I should have said that you have become accustomed to or used to various forms of AI.

Ok, that I very much agree with.


No problem at all Art, I think we all knew what angles we were each coming at and were respecting our individual views.  It's all good :)

I second that.

*

Bragi

  • Trusty Member
  • ********
  • Replicant
  • *
  • 564
    • Neural network design blog
Re: Computer that "Learns" how to play a game...
« Reply #12 on: September 29, 2012, 06:51:38 pm »
I think that a combination of n-grams, random forests, logistic regression and a whole lot of computing power should be able to do the trick.
It sounds a lot like an advanced kaggle competition: all about machine learning.

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

314 Guests, 0 Users

Most Online Today: 507. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles