Poll

What challenge to replace the Loebner Prize?

The Loebner Prize was perfect. Nothing should be changed.
0 (0%)
The Winograd Schemas Challenge is the best test of intelligence.
1 (12.5%)
The OnlineTuring Test needs to be more developed, or adapted (number of rounds, frequency, protocol).
2 (25%)
A board game that requires dialogue, lies and bluffing (like "The Werewolves of Miller's Hollow" for example).
0 (0%)
Bring chatbots into a virtual world that would require dialogue and mutual assistance. After all humans have developed their intelligence and language to survive in a harsh environment.
3 (37.5%)
Any prize will be good as long as there is a big sum of money to be won.
0 (0%)
We don't need a competition. It's a waste of time.
0 (0%)
Other.
2 (25%)

Total Members Voted: 8

What challenge to replace the Loebner Prize?

  • 17 Replies
  • 7423 Views
*

MagnusWootton

  • Replicant
  • ********
  • 646
Re: What challenge to replace the Loebner Prize?
« Reply #15 on: June 09, 2022, 09:58:25 am »
locking ppl out of competitions is a devolution.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: What challenge to replace the Loebner Prize?
« Reply #16 on: June 09, 2022, 07:28:51 pm »
Actually I might be wrong about the kind of extreme Turing Test I mentioned taking longer than Perplexity. I mean if you see some presented system can learn to ride a bike, research, solve problems, and conversate, for a few hours, isn't that enough? Why must one really test it on all tasks and each task 5,000 problems? Ex. summarize this, and that, etc, etc, etc...........translate this, and that etc, etc, etc..............etc etc etc etc etc? Surely, humans know an AGI by looking at it only for a while.

Maybe Perplexity only takes a few minutes or hours to run, while TT takes days/ weeks? And checking lifespan/ clone colony size takes too long for any of us to test? That last one takes little compute but long time to run. TT takes some compute/intelligence and some time - it's more middle ground, it is the best option? Perplexity takes lots of compute but is fastest. However Perplexity doesn't seem to take too much compute that it is infeasible to run at all, it seems like the best way to use most the time then. Any time you add a new part to your AGI, ex. embeds, or RL, you should be able to test it on thousands of tasks to see if it is scoring good.
Emergent          https://openai.com/blog/

*

MagnusWootton

  • Replicant
  • ********
  • 646
Re: What challenge to replace the Loebner Prize?
« Reply #17 on: June 10, 2022, 07:59:04 am »
Perplexity I just looked up the word,  is it how complex the data stream can be, before it becomes non predictable.

And its definitely semantically oriented, because u cant look at data redundancy in a general way,  its how you tackle the problem that makes it predictable, and that is data specific.

If u look at redundancy generally, u are guaranteed failure.   thats what I reckon.

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
Today at 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

178 Guests, 0 Users

Most Online Today: 390. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles