Anyone here know lots about Transformers? I'll pay you.

  • 27 Replies
  • 3573 Views
*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #15 on: May 27, 2019, 11:43:06 am »
see new jpg update + hilarious generation in above post, final drawing update

edit...png....for this image it was smaller size, and the jpg was horrible quality!!
Emergent          https://openai.com/blog/

*

8pla.net

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1302
  • TV News. Pub. UAL (PhD). Robitron Mod. LPC Judge.
    • 8pla.net
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #16 on: May 27, 2019, 12:04:24 pm »
Start porting the mathematics notation and flowcharts into source code to help determine what may be missing.
Each of the symbols has a meaning which may then extend out into lines of source code.

My Very Enormous Monster Just Stopped Using Nine

*

Korrelan

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1454
  • Look into my eyes! WOAH!
    • YouTube
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #17 on: May 27, 2019, 12:08:43 pm »
Quote
Korrelan, can you please draw the rest of the GPT-2 Transformer diagram.

I simply don’t have the time lock, and there would be no point for several reasons. I could just draw a box with an input and output, or I could draw the billions of links of all the various NN schemas used in the GPT architecture, no matter how complex the diagram you will still not understand it, you have to actually take the time to learn/ understand the individual concepts the GPT is constructed from. 

I would spend hours and you would be none the wiser, then I would have to explain, etc, etc.  Diagrams just give an outline at a specific level of abstraction; you have to understand what each section is actually doing, pragmatically/ mathematically.  There are no short-cuts Lock, if it was a mechanical schematic then yes, a better diagram would help… also you do realise the kind of processing power and time it takes to train/ implement something like this.

Besides, the GPT-2 architecture whilst interesting is not the solution to AGI, not even close... the answer is GTP not GPT.

 :)
It thunk... therefore it is!...    /    Project Page    /    KorrTecx Website

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #18 on: May 27, 2019, 12:33:48 pm »
AGI=R&D...GPT-2 discovers answers .... Data Science https://deepai.org/machine-learning-glossary-and-terms/data-science
Does your GTP really do better R&D? It looks like theory and nothing more...

As you can see in my diagram, I am trying to show with numbers in a toy example why the Next Word is chosen, which means I will be able to see exactly how it works... It's just missing a few layers of matrices at the moment...
Emergent          https://openai.com/blog/

*

8pla.net

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1302
  • TV News. Pub. UAL (PhD). Robitron Mod. LPC Judge.
    • 8pla.net
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #19 on: May 27, 2019, 12:47:25 pm »
FFN(𝒙)=max(0,𝒙W₁+b₁)Wâ‚‚+bâ‚‚

Code
<?php

/*    FFN(x)=max(0,xW₁+b₁)Wâ‚‚+bâ‚‚ */

function FFN($x)
{
$W=array(0,1,2);
$b=array(0,1,2);
return max(0, ($x*$W[1]+$b[1]))*($W[2]+$b[2]);
}

echo "Planets: ". FFN(1);


?>

Program Output

Planets: 8
My Very Enormous Monster Just Stopped Using Nine

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #20 on: May 27, 2019, 12:48:24 pm »
You get the prize money.
Emergent          https://openai.com/blog/

*

AndyGoode

  • Guest
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #21 on: May 27, 2019, 02:08:45 pm »
Seems more like you must be a Google expert.

Don't use Google. That has become a bad word lately. Use duckduckgo.com or some other non-G-word search engine that doesn't send all your searches and your ID to the government.

Anyway, if you want AI expertise I can provide that, but not Transformers expertise. It's not clear which expertise you really want.

*

Korrelan

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1454
  • Look into my eyes! WOAH!
    • YouTube
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #22 on: May 27, 2019, 03:25:55 pm »
Quote
Does your GTP really do better R&D? It looks like theory and nothing more...

OMG Lock… I’m mortally wounded… and I thought you believed in GTP theory… I thought we were friends, colleagues, brothers in arms… Is that a tear I feel welling…

 :)
It thunk... therefore it is!...    /    Project Page    /    KorrTecx Website

*

goaty

  • Trusty Member
  • ********
  • Replicant
  • *
  • 552
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #23 on: May 27, 2019, 08:25:16 pm »
Look Lockster,  your ai isn't that good,  no-ones is...  especially if they don't even do their own code.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #24 on: May 27, 2019, 11:42:24 pm »
@korr lol... I seen a lot of your work, the stuff you DO show us... there's a lot to it but overall the objective is simple... I notice you are doing the right stuff/objective, data science/ scientific method/ data transform... while at the same time I don't see any text/video generation of transforming/entailment/segmentation, only your side project and one drawing, otherwise it always just neural fireworks in all your videos lol... how is it going to change Earth the way we want it to change?

AGI=data transformation/recognition, entailment, and segmentation...either AGI uses its own hands to enact its discovered plans of action, or it tells us what it figured out to do... You feed it knowledge, show it action skills, then it thinks and discovers things it wants to discover. Humans invented everything around us, it must continue that trend.
Emergent          https://openai.com/blog/

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #25 on: May 28, 2019, 12:50:18 am »
also, just found this by ThomasWolf, less than 35 lines of code, GPT-2!:

come on korr......35 lines, 40 GBs, and 400USD of prize money
Emergent          https://openai.com/blog/

*

HS

  • Trusty Member
  • **********
  • Millennium Man
  • *
  • 1175
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #26 on: May 28, 2019, 01:17:50 am »
So will it write the last book in an unfinished series if you feed it the previous novels? How many patterns does it take into account?

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Anyone here know lots about Transformers? I'll pay you.
« Reply #27 on: May 28, 2019, 01:28:43 am »
I sent Thomas an email to see the results of it.
« Last Edit: May 28, 2019, 11:09:12 am by LOCKSUIT »
Emergent          https://openai.com/blog/

 


OpenAI Speech-to-Speech Reasoning Demo
by ivan.moony (AI News )
Today at 01:31:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

283 Guests, 1 User
Users active in past 15 minutes:
ivan.moony
[Trusty Member]

Most Online Today: 346. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles