Wu Dao ten times bigger than GPT3

  • 7 Replies
  • 41548 Views
*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
Wu Dao ten times bigger than GPT3
« on: June 04, 2021, 01:43:53 am »
https://www.engadget.com/chinas-gigantic-multi-modal-ai-is-no-one-trick-pony-211414388.html

Quote
“The way to artificial general intelligence is big models and big computer,” Dr. Zhang Hongjiang, chairman of BAAI, said during the conference Tuesday. “What we are building is a power plant for the future of AI, with mega data, mega computing power, and mega models, we can transform data to fuel the AI applications of the future.”

Wu Dao has one big advantage over its competition in that it doesn't require specialized hardware to run it. It does just fine on ordinary supercomputer clusters.  ;)

https://thenextweb.com/news/china-wu-dao-ai-10x-bigger-than-gpt-3

Quote
A steadily-increasing number of AI and computer science experts are under the belief that deep learning is a dead-end street for general artificial intelligence. We may already be seeing diminishing returns on power if the most exciting thing about a system trained on supercomputer clusters with 1.75T parameters is that it can generate digital pop stars.

Nevertheless I don't see AI getting chilly again any time soon. There's too much at stake.

*

MagnusWootton

  • Replicant
  • ********
  • 646
Re: Wu Dao ten times bigger than GPT3
« Reply #1 on: June 05, 2021, 04:32:09 am »
What about the idea that its not how many text patterns you have, its how you used them?

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
Re: Wu Dao ten times bigger than GPT3
« Reply #2 on: June 05, 2021, 05:04:59 am »
What about the idea that it's not how many text patterns you have, it's how you use them?

That's where the magic would be, the magic that is still missing. At the very least you need to be able to tell the difference between signal and noise. Being able to predict input perfectly is still useless if you don't know what it means.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Wu Dao ten times bigger than GPT3
« Reply #3 on: June 12, 2021, 08:25:57 am »
"Being able to predict input perfectly is still useless if you don't know what it means"

Not really, patterns are the only thing that exist. All you can do in 100GB of text/ images/ world is find, be, create patterns. Chaos is non re-occurrence. What is life, or light bulbs, or rules, or tasty, or neat, is patterns, re-use, general purpose computer/AI. A man and rock are very similar, they're all just atoms, one lasts longer - by creating patterns.
Emergent          https://openai.com/blog/

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Wu Dao ten times bigger than GPT3
« Reply #4 on: July 05, 2021, 12:40:15 pm »
Look at this.
Yet more immense computer power:
https://lightmatter.co/
Emergent          https://openai.com/blog/

*

MagnusWootton

  • Replicant
  • ********
  • 646
Re: Wu Dao ten times bigger than GPT3
« Reply #5 on: July 05, 2021, 04:58:52 pm »
"Being able to predict input perfectly is still useless if you don't know what it means"

Not really, patterns are the only thing that exist. All you can do in 100GB of text/ images/ world is find, be, create patterns. Chaos is non re-occurrence. What is life, or light bulbs, or rules, or tasty, or neat, is patterns, re-use, general purpose computer/AI. A man and rock are very similar, they're all just atoms, one lasts longer - by creating patterns.

you need to assign the unknown patterns to something,  then u at least have some "relative meaning".  Your right there is no meaning, it just depends on how its connecting together as a machine?


Look at this.
Yet more immense computer power:
https://lightmatter.co/

You should get into the hardware business yourself,  dont let people tell you "you cant do things" let them just tell themselves that.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Wu Dao ten times bigger than GPT3
« Reply #6 on: July 06, 2021, 07:41:19 pm »
"Being able to predict input perfectly is still useless if you don't know what it means"

Not really, patterns are the only thing that exist. All you can do in 100GB of text/ images/ world is find, be, create patterns. Chaos is non re-occurrence. What is life, or light bulbs, or rules, or tasty, or neat, is patterns, re-use, general purpose computer/AI. A man and rock are very similar, they're all just atoms, one lasts longer - by creating patterns.

you need to assign the unknown patterns to something,  then u at least have some "relative meaning".  Your right there is no meaning, it just depends on how its connecting together as a machine?

>"Your right there is no meaning, it just depends on how its connecting together as a machine?"

Not even that, simply all that exists is patterns/rules in the universe, and some are bigger / last longer. We are not different than rocks, we just/cough will last longer. As a machine, like me and you, we can't know if we are really here or exist, so who's watching the movie? Am I here? The universe is talking to itself, knock knock.
Emergent          https://openai.com/blog/

*

MagnusWootton

  • Replicant
  • ********
  • 646
Re: Wu Dao ten times bigger than GPT3
« Reply #7 on: July 06, 2021, 07:49:37 pm »
I cant explain consciousness,  I think its more than just a machine and I don't plan to bother ever explaining it,  I'm just into the Ai stuff for the automation.

I haven't been uploading alot lately,  but I'm still working pretty hard,   I'm working on that strange lever oscillator and now I'm plugging something extra special behind it.    All mouldable and castable and heavily repeatable! =)  Just how I like it.

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

228 Guests, 0 Users

Most Online Today: 357. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles