So backprop is just a program generator?

  • 2 Replies
  • 831 Views
*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
So backprop is just a program generator?
« on: May 07, 2019, 06:54:45 am »
Now the puzzle comes even closer together.

Neural networks...backprop...

It's a faster way than "brute force generating all possible computer programs from smallest to largest". You show the network a lot of (desired) data inputs, and want it to give certain desired outputs. This reward function is one to generate a desired program, by measuring the error Cost and adjusting the weights via backprop. This is training...generating the finished program and selling it trained (generated). No wonder they don't learn online and require re-training. This isn't AI...it's program generation. This is why it's a black box in the hidden layers. This is why we have CNNs and RNNs and GANs. I notice CNNs have padding etc, not fully a generated program. GANs have a generator & detective that compete to learn how to give the right outputs. A classifier / feature/representation learning is made through this.

Did I miss something?

Now it makes further sense why I have new Costs I discovered in my research, I have the real Costs.
« Last Edit: May 07, 2019, 08:03:57 am by LOCKSUIT »
Emergent          https://openai.com/blog/

*

goaty

  • Trusty Member
  • ********
  • Replicant
  • *
  • 552
Re: So backprop is just a program generator?
« Reply #1 on: May 07, 2019, 08:05:02 am »
I vote it is too, but its not necessarily faster unless you make it faster.  back prop is a slow process, I prefer knn memories more myself, for a few technical reasons.

And its not so simple Lockster,  the computer can form a "thinking device" or computation device,  but its not the computer that can build its own brain.  U are supplying all facilities that the a.i. will be equipped with.

You equip the ai,  it cant equip itself,  and im meaning the metrics involved in your target application must be very carefully picked,  and its only going to go so good.
Helps if uve got the right correlative sensors+ semantic truth.

If you give the machine the wrong clue for the task,  it wont go any good, it doesn't even matter if its full knn similarity matched, it wont work.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: So backprop is just a program generator?
« Reply #2 on: May 07, 2019, 08:16:37 am »
Correct, you give it the sensor functions, motor, the data, desired output 'reward function' for generating the program that generates outputs how you asked for, etc. Some of it is hand-made.
Emergent          https://openai.com/blog/

 


OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

269 Guests, 0 Users

Most Online Today: 297. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles