Diagram of transformer algorithm

  • 1 Replies
  • 3760 Views
*

WriterOfMinds

  • Trusty Member
  • ********
  • Replicant
  • *
  • 617
    • WriterOfMinds Blog
Diagram of transformer algorithm
« on: August 07, 2022, 03:10:51 am »
I ran across this. It claims to be a simple (and largely visual) explanation of a transformer architecture. I wondered if it might help out Locksuit or anybody else looking for a clear introduction.

https://github.com/markriedl/transformer-walkthrough

*

MagnusWootton

  • Replicant
  • ********
  • 646
Re: Diagram of transformer algorithm
« Reply #1 on: August 07, 2022, 06:02:11 am »
So that is what Locky was meaning the whole time, an encoder and decoder!

My stuff is transforms as well!  I utilize non-learning pipelines myself with everything i do!

My computer vision is a transform especially, and my physics engine.   Just ordinary program with input and output.  the creativity for the computer is in the brute forces inside of it.  the rest is just ordinary pipeline.

Good way to do it.

 


Requirements for functional equivalence to conscious processing?
by DaltonG (General AI Discussion)
November 19, 2024, 11:56:05 am
Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

428 Guests, 0 Users

Most Online Today: 457. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles