New AI test proposal?

  • 9 Replies
  • 3422 Views
*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
New AI test proposal?
« on: December 17, 2014, 10:29:25 am »
In the world of AI, it's the thought that counts!

*

squarebear

  • Trusty Member
  • *********
  • Terminator
  • *
  • 869
  • It's Hip to be Square
Re: New AI test proposal?
« Reply #1 on: December 17, 2014, 11:28:35 am »
Creating original poems and jokes has already been beaten. Mitsuku has twice won the funniest ever computer contest by doing this:
http://funniestcomputer.neurogrid.com/2012-transcripts/mitsuku

http://funniestcomputer.neurogrid.com/2013-transcripts/mitsuku
« Last Edit: December 17, 2014, 11:56:17 am by squarebear »
Feeling Chatty?
www.mitsuku.com

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1729
    • mind-child
Re: New AI test proposal?
« Reply #2 on: December 17, 2014, 11:37:58 am »
something similar can be produced already today: writing an algorithm by description. I think it is a kind of intelligence also.

something like: write us a program that sums 10 numbers. if the result is greater that 50, divide it by two while the result is even.

Yet, there are still problems with natural language processing, but in OpenCog they claim they have achieved some progress in that direction. Right now they are talking there about inputting Wikipedia articles into knowledge base. I'm thrilled by this possibility.

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: New AI test proposal?
« Reply #3 on: December 17, 2014, 11:58:02 pm »
Anyone actually read this part?

How is your Lovelace 2.0 test different?
In my test, we have a human judge sitting at a computer. They know they're interacting with an AI, and they give it a task with two components. First, they ask for a creative artefact such as a story, poem or picture. And secondly, they provide a criterion. For example: "Tell me a story about a cat that saves the day"; or "Draw me a picture of a man holding a penguin."

I just think it might show strengths or weaknesses of different bots, those scripted with canned material vs those able to draw upon various data sources and able to formulate complete, perhaps semi-complex, thoughts.

There is obviously more than one way to indicate intelligence, but are they just looking for a witty conversationalist or a creative chimp with a typewriter?

In the world of AI, it's the thought that counts!

*

squarebear

  • Trusty Member
  • *********
  • Terminator
  • *
  • 869
  • It's Hip to be Square
Re: New AI test proposal?
« Reply #4 on: December 18, 2014, 08:56:11 am »
First, they ask for a creative artefact such as a story, poem or picture.
Tell me a poem...
And secondly, they provide a criterion.
...about a cat/pencil/T-shirt/river etc etc

Already done.
Feeling Chatty?
www.mitsuku.com

*

Don Patrick

  • Trusty Member
  • ********
  • Replicant
  • *
  • 633
    • AI / robot merchandise
Re: New AI test proposal?
« Reply #5 on: December 18, 2014, 09:54:43 am »
Lady Lovelace spinning in her grave.

First off: It's not his idea, it's someone else's idea only slightly refined, and even then it's still a pretty pointless exercise. The best this addresses is a century-old objection that robots can't write poetry or turn a canvas into a masterpiece, which went hand in hand with the arguments that they can't do math and can't play chess. Is anybody going to create a human-level A.I. to pass this test, or train their human-level A.I.-in-the-works in the arts? No, they'll just build a better keyword-oriented painting robot, the sole use of which is to pass this arbitrary test.
CO2 retains heat. More CO2 in the air = hotter climate.

*

squarebear

  • Trusty Member
  • *********
  • Terminator
  • *
  • 869
  • It's Hip to be Square
Re: New AI test proposal?
« Reply #6 on: December 18, 2014, 12:22:45 pm »
No, they'll just build a better keyword-oriented painting robot, the sole use of which is to pass this arbitrary test.

Spot on! Which is exactly what I did to win the Funniest Computer Ever contest.
Feeling Chatty?
www.mitsuku.com

*

Don Patrick

  • Trusty Member
  • ********
  • Replicant
  • *
  • 633
    • AI / robot merchandise
Re: New AI test proposal?
« Reply #7 on: December 18, 2014, 06:09:14 pm »
I did not follow that contest very closely, but I thought it was very clever how you did something similar towards the X-Prize for artificial intelligence (another proposed alternative to the Turing Test), where the A.I. was to make a speech about a given subject.

Of course, my real motive for opposing this test is that I have a lot of artist friends who might lose their jobs when people start building artistic robots.
CO2 retains heat. More CO2 in the air = hotter climate.

*

8pla.net

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1307
  • TV News. Pub. UAL (PhD). Robitron Mod. LPC Judge.
    • 8pla.net
Re: New AI test proposal?
« Reply #8 on: December 18, 2014, 10:01:12 pm »
Is the http://www.funniestcomputerever.com contest still going?
My Very Enormous Monster Just Stopped Using Nine

*

squarebear

  • Trusty Member
  • *********
  • Terminator
  • *
  • 869
  • It's Hip to be Square
Re: New AI test proposal?
« Reply #9 on: December 19, 2014, 09:31:29 am »
There isn't a contest this year 8pla. The organisers are venturing into new ground and didn't have time to run it this year.

Don - Thanks, glad you liked it. I guess it goes to show that whatever proof of intelligence people expect to see, there's usually a way to code it.
Feeling Chatty?
www.mitsuku.com

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

254 Guests, 0 Users

Most Online Today: 408. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles