Ai Dreams Forum

Artificial Intelligence => General AI Discussion => Topic started by: LOCKSUIT on May 24, 2019, 11:33:32 pm

Title: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 24, 2019, 11:33:32 pm
After seeing GPT-2, I want to know how Transformers work for my advanced research. I got the plans but the terminology of their (and their) implementation is simply different. I need a mentor to hire that understands a ton about them though. All the online articles mean 0 to me. What is 'residual'??? And even if, how do they fit together!? Seems more like you must be a Google expert. Looking forward to proposals.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 25, 2019, 12:38:44 am
On the plus side i just sent 30 emails to 30 random people too.

Everything works in numbers  #.#  8.8  O.O  ^.^

One will write me and give it the punch. If I'm lucky.

I think I hit it off on one last email. Excited O0.

Cm on korr where is your Transformer skills, arnt u up to date bro???? ^+^
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: Korrelan on May 25, 2019, 10:24:12 am
Quote
Cm on korr where is your Transformer skills, arnt u up to date bro???? ^+^

To correctly understand Transformers you have to thoroughly understand NN, RNN, CNN, LSTM, sequence to sequence, and all the techniques, methods used with them.

I’m quite capable of back engineering the human brain and building a machine equivalent, but as far as teaching you about Transformers is concerned… I know my limitations.

 :)
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 25, 2019, 11:02:46 am
currently i'm putting together a viz......you'll see.........come back in a day or so
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: squarebear on May 25, 2019, 03:19:06 pm
<----- *walks in the thread excited to share his knowledge about Optimus Prime and Decepticons *
* reads first post*
* slowly walks out*
;D
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: goaty on May 25, 2019, 04:32:39 pm
You mean synonym detection don't you.
boot=shoe?

If you do this,  you can increase your chat bots attention span,  from 4 words to 16 or something.

Easiest quick and nasty way to do it ->

So,  pick a window size a bit larger than you were originally planning.

Then whenever you get two outputs with the same Input,   you actually make them mean the same thing,  interchange the outputs into all the other patterns,   and then you rinse repeat until it stops finding them.   

So for every fork it gets,  it actually gets forks everywhere else as well,  making it more plastic -and its a superior system, I like to think.

(it has a compounding effect, it causes a chain reaction.)

Youll get a bit of playability back,    and your attention size will be increased.

If you want to think about it more,  theres better ways and things to do with it that make it a better finished product.   But u need to implement yourself!

The other thing to do,   have is I to you tell something English about.
order word important not.   Is it clarity for but meaning not for.

If u heard this from me,  I call it "yoda chains"  instead of "markov chains."  =D  Because he sounds funny when he speaks.

So when it goes into the system, it must reduce all difference that is superfluous, to the concepts.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 25, 2019, 10:53:41 pm
GOA, I knew all that, and taught you that too, my young yoda master!

Got something really cool coming, i'm gonna get that gpt2 diagram........and, i got a freelancer that knows Transformers now too. Check back in a days time.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: goaty on May 26, 2019, 12:35:57 am
If you know that,  then you know enough to write a good text system.    Im going to be proud of mine, when I finally get to tapping it in.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 26, 2019, 02:20:54 pm
Put a full day in on Transformers......hhuu.......pooped............

I took many many different diagrams and articles, and have 2 rough drafts after just 1.6 days, which must be combined and simplified still. Then hire freelancer.

Lock shows his True Machine Learning knowledge below! What you think about that korr!?

Now that, is the real GPT-2 master diagram!
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: Freddy on May 26, 2019, 02:30:12 pm
Lock, can I ask that you use jpg to upload in future please. These PNGs take up a lot of unnecessary space. Thanks.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: 8pla.net on May 26, 2019, 03:42:26 pm
Lock, can I ask that you use jpg to upload in future please. These PNGs take up a lot of unnecessary space. Thanks.

The embedded color profile on that PNG is: Copyright Apple Inc., 2017

                      ** For discussion purposes only **

A simple test shows changing the mode of that image to indexed,
makes it 39.6% the filesize.  A JPG by comparison, shows 63.3% the filesize.
Posterization (reducing to a limited set of colors) gets it down to 22%.
And, that doesn't even get into PNG compression.  Your mileage may vary.





Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: Freddy on May 26, 2019, 04:06:34 pm
Anything that reduces file size gets my support, but let's not discuss this further here as it will take Lock's topic off the rails.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: Korrelan on May 27, 2019, 11:15:31 am
Quote
What you think about that korr!?

There is a distinction between collecting images/ information on a subject and actually learning and understanding it to a level of implementation, only time will tell if it's the latter but... I'm always happy to see someone learning something new.

 :)
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 27, 2019, 11:20:38 am
I need someone to re-draw / correct the entrance I started drawing there....I started the entrance but now I need help

(image "super intuitive viz" in the above post)

I want to see visually with all the vectors etc a real example of how GPT-2 predicts the next word in "I was petting a large _"
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 27, 2019, 11:27:28 am
see above, I like how GPT-2 345M finished my prompt: HILARIOUS FROM START TO FINISH!!!!!

Korrelan, can you please draw the rest of the GPT-2 Transformer diagram

for this section? Please do.I haven't done a good quality schematic ever since I started reading up on them, and I like the basic idea of GPT, but I'd prefer a better looking one that I could get my hands on. Please help me!My drawing is quite rough, and it does include more than enough parts for me to get something out of this project. I'd especially like to get a sketch of the two main components of the Transformer circuit, the potentiometer, capacitors, and resistors. There are several ways I could make these sketches, including some with the appropriate parts, some without, and a couple with the correct parts. Also, there's not exactly anything that I could do after I made that diagram, so I doubt it would really require very much.For example, I would like to learn about what parts are needed for all these components. That might be hard to find and even harder to find someone who knows about it, but there is certainly a forum, such as DAE Wiki, where anyone who wants to write down the parts, and has a schematic of an appropriate level, can do that easily. If people are willing to read the schematics and make it possible for me to make a sketch of the schematic for this
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 27, 2019, 11:43:06 am
see new jpg update + hilarious generation in above post, final drawing update

edit...png....for this image it was smaller size, and the jpg was horrible quality!!
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: 8pla.net on May 27, 2019, 12:04:24 pm
Start porting the mathematics notation and flowcharts into source code to help determine what may be missing.
Each of the symbols has a meaning which may then extend out into lines of source code.

Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: Korrelan on May 27, 2019, 12:08:43 pm
Quote
Korrelan, can you please draw the rest of the GPT-2 Transformer diagram.

I simply don’t have the time lock, and there would be no point for several reasons. I could just draw a box with an input and output, or I could draw the billions of links of all the various NN schemas used in the GPT architecture, no matter how complex the diagram you will still not understand it, you have to actually take the time to learn/ understand the individual concepts the GPT is constructed from. 

I would spend hours and you would be none the wiser, then I would have to explain, etc, etc.  Diagrams just give an outline at a specific level of abstraction; you have to understand what each section is actually doing, pragmatically/ mathematically.  There are no short-cuts Lock, if it was a mechanical schematic then yes, a better diagram would help… also you do realise the kind of processing power and time it takes to train/ implement something like this.

Besides, the GPT-2 architecture whilst interesting is not the solution to AGI, not even close... the answer is GTP not GPT.

 :)
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 27, 2019, 12:33:48 pm
AGI=R&D...GPT-2 discovers answers .... Data Science https://deepai.org/machine-learning-glossary-and-terms/data-science
Does your GTP really do better R&D? It looks like theory and nothing more...

As you can see in my diagram, I am trying to show with numbers in a toy example why the Next Word is chosen, which means I will be able to see exactly how it works... It's just missing a few layers of matrices at the moment...
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: 8pla.net on May 27, 2019, 12:47:25 pm
FFN(𝒙)=max(0,𝒙W₁+b₁)Wâ‚‚+bâ‚‚

Code
<?php

/*    FFN(x)=max(0,xW₁+b₁)Wâ‚‚+bâ‚‚ */

function FFN($x)
{
$W=array(0,1,2);
$b=array(0,1,2);
return max(0, ($x*$W[1]+$b[1]))*($W[2]+$b[2]);
}

echo "Planets: ". FFN(1);


?>

Program Output

Planets: 8
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 27, 2019, 12:48:24 pm
You get the prize money.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: AndyGoode on May 27, 2019, 02:08:45 pm
Seems more like you must be a Google expert.

Don't use Google. That has become a bad word lately. Use duckduckgo.com or some other non-G-word search engine that doesn't send all your searches and your ID to the government.

Anyway, if you want AI expertise I can provide that, but not Transformers expertise. It's not clear which expertise you really want.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: Korrelan on May 27, 2019, 03:25:55 pm
Quote
Does your GTP really do better R&D? It looks like theory and nothing more...

OMG Lock… I’m mortally wounded… and I thought you believed in GTP theory… I thought we were friends, colleagues, brothers in arms… Is that a tear I feel welling…

 :)
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: goaty on May 27, 2019, 08:25:16 pm
Look Lockster,  your ai isn't that good,  no-ones is...  especially if they don't even do their own code.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 27, 2019, 11:42:24 pm
@korr lol... I seen a lot of your work, the stuff you DO show us... there's a lot to it but overall the objective is simple... I notice you are doing the right stuff/objective, data science/ scientific method/ data transform... while at the same time I don't see any text/video generation of transforming/entailment/segmentation, only your side project and one drawing, otherwise it always just neural fireworks in all your videos lol... how is it going to change Earth the way we want it to change?

AGI=data transformation/recognition, entailment, and segmentation...either AGI uses its own hands to enact its discovered plans of action, or it tells us what it figured out to do... You feed it knowledge, show it action skills, then it thinks and discovers things it wants to discover. Humans invented everything around us, it must continue that trend.
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 28, 2019, 12:50:18 am
also, just found this by ThomasWolf, less than 35 lines of code, GPT-2!:

come on korr......35 lines, 40 GBs, and 400USD of prize money
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: HS on May 28, 2019, 01:17:50 am
So will it write the last book in an unfinished series if you feed it the previous novels? How many patterns does it take into account?
Title: Re: Anyone here know lots about Transformers? I'll pay you.
Post by: LOCKSUIT on May 28, 2019, 01:28:43 am
I sent Thomas an email to see the results of it.