Wu Dao ten times bigger than GPT3

  • 3 Replies
  • 138 Views
*

infurl

  • Administrator
  • **********
  • Millennium Man
  • *
  • 1209
  • Humans will disappoint you.
    • Home Page
Wu Dao ten times bigger than GPT3
« on: June 04, 2021, 01:43:53 am »
https://www.engadget.com/chinas-gigantic-multi-modal-ai-is-no-one-trick-pony-211414388.html

Quote
“The way to artificial general intelligence is big models and big computer,” Dr. Zhang Hongjiang, chairman of BAAI, said during the conference Tuesday. “What we are building is a power plant for the future of AI, with mega data, mega computing power, and mega models, we can transform data to fuel the AI applications of the future.”

Wu Dao has one big advantage over its competition in that it doesn't require specialized hardware to run it. It does just fine on ordinary supercomputer clusters.  ;)

https://thenextweb.com/news/china-wu-dao-ai-10x-bigger-than-gpt-3

Quote
A steadily-increasing number of AI and computer science experts are under the belief that deep learning is a dead-end street for general artificial intelligence. We may already be seeing diminishing returns on power if the most exciting thing about a system trained on supercomputer clusters with 1.75T parameters is that it can generate digital pop stars.

Nevertheless I don't see AI getting chilly again any time soon. There's too much at stake.

*

MagnusWootton

  • Electric Dreamer
  • ****
  • 110
Re: Wu Dao ten times bigger than GPT3
« Reply #1 on: June 05, 2021, 04:32:09 am »
What about the idea that its not how many text patterns you have, its how you used them?

*

infurl

  • Administrator
  • **********
  • Millennium Man
  • *
  • 1209
  • Humans will disappoint you.
    • Home Page
Re: Wu Dao ten times bigger than GPT3
« Reply #2 on: June 05, 2021, 05:04:59 am »
What about the idea that it's not how many text patterns you have, it's how you use them?

That's where the magic would be, the magic that is still missing. At the very least you need to be able to tell the difference between signal and noise. Being able to predict input perfectly is still useless if you don't know what it means.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4510
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Wu Dao ten times bigger than GPT3
« Reply #3 on: June 12, 2021, 08:25:57 am »
"Being able to predict input perfectly is still useless if you don't know what it means"

Not really, patterns are the only thing that exist. All you can do in 100GB of text/ images/ world is find, be, create patterns. Chaos is non re-occurrence. What is life, or light bulbs, or rules, or tasty, or neat, is patterns, re-use, general purpose computer/AI. A man and rock are very similar, they're all just atoms, one lasts longer - by creating patterns.
Emergent

 


Fifteen Advanced AI eBooks on sale
by infurl (AI News )
June 14, 2021, 11:14:55 pm
Wu Dao ten times bigger than GPT3
by LOCKSUIT (AI News )
June 12, 2021, 08:25:57 am
New challenge: Online Turing test
by WriterOfMinds (AI News )
June 08, 2021, 02:43:00 am
Disinformation Countermeasures
by MagnusWootton (AI News )
May 31, 2021, 09:39:05 am

Users Online

94 Guests, 0 Users

Most Online Today: 151. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles