Poll

What challenge to replace the Loebner Prize?

The Loebner Prize was perfect. Nothing should be changed.
0 (0%)
The Winograd Schemas Challenge is the best test of intelligence.
1 (12.5%)
The OnlineTuring Test needs to be more developed, or adapted (number of rounds, frequency, protocol).
2 (25%)
A board game that requires dialogue, lies and bluffing (like "The Werewolves of Miller's Hollow" for example).
0 (0%)
Bring chatbots into a virtual world that would require dialogue and mutual assistance. After all humans have developed their intelligence and language to survive in a harsh environment.
3 (37.5%)
Any prize will be good as long as there is a big sum of money to be won.
0 (0%)
We don't need a competition. It's a waste of time.
0 (0%)
Other.
2 (25%)

Total Members Voted: 8

What challenge to replace the Loebner Prize?

  • 17 Replies
  • 511 Views
*

MagnusWootton

  • Replicant
  • ********
  • 531
Re: What challenge to replace the Loebner Prize?
« Reply #15 on: June 09, 2022, 09:58:25 am »
locking ppl out of competitions is a devolution.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4638
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: What challenge to replace the Loebner Prize?
« Reply #16 on: June 09, 2022, 07:28:51 pm »
Actually I might be wrong about the kind of extreme Turing Test I mentioned taking longer than Perplexity. I mean if you see some presented system can learn to ride a bike, research, solve problems, and conversate, for a few hours, isn't that enough? Why must one really test it on all tasks and each task 5,000 problems? Ex. summarize this, and that, etc, etc, etc...........translate this, and that etc, etc, etc..............etc etc etc etc etc? Surely, humans know an AGI by looking at it only for a while.

Maybe Perplexity only takes a few minutes or hours to run, while TT takes days/ weeks? And checking lifespan/ clone colony size takes too long for any of us to test? That last one takes little compute but long time to run. TT takes some compute/intelligence and some time - it's more middle ground, it is the best option? Perplexity takes lots of compute but is fastest. However Perplexity doesn't seem to take too much compute that it is infeasible to run at all, it seems like the best way to use most the time then. Any time you add a new part to your AGI, ex. embeds, or RL, you should be able to test it on thousands of tasks to see if it is scoring good.
Emergent          https://openai.com/blog/

*

MagnusWootton

  • Replicant
  • ********
  • 531
Re: What challenge to replace the Loebner Prize?
« Reply #17 on: June 10, 2022, 07:59:04 am »
Perplexity I just looked up the word,  is it how complex the data stream can be, before it becomes non predictable.

And its definitely semantically oriented, because u cant look at data redundancy in a general way,  its how you tackle the problem that makes it predictable, and that is data specific.

If u look at redundancy generally, u are guaranteed failure.   thats what I reckon.