Diagram of transformer algorithm

  • 1 Replies
  • 27 Views
*

WriterOfMinds

  • Trusty Member
  • ********
  • Replicant
  • *
  • 527
    • WriterOfMinds Blog
Diagram of transformer algorithm
« on: Today at 03:10:51 am »
I ran across this. It claims to be a simple (and largely visual) explanation of a transformer architecture. I wondered if it might help out Locksuit or anybody else looking for a clear introduction.

https://github.com/markriedl/transformer-walkthrough

*

MagnusWootton

  • Replicant
  • ********
  • 531
Re: Diagram of transformer algorithm
« Reply #1 on: Today at 06:02:11 am »
So that is what Locky was meaning the whole time, an encoder and decoder!

My stuff is transforms as well!  I utilize non-learning pipelines myself with everything i do!

My computer vision is a transform especially, and my physics engine.   Just ordinary program with input and output.  the creativity for the computer is in the brute forces inside of it.  the rest is just ordinary pipeline.

Good way to do it.