GANs are not novel I think

  • 2 Replies
  • 1536 Views
*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
GANs are not novel I think
« on: August 16, 2020, 09:02:12 pm »
GANs are said to have 2 networks compete against each other, improving each other, one gets better at generating ex. realistic images, the other gets better at identifying fake images. But I think I found proof it is just a normal network in the end, not 2 and not anything new, just a new way of doing the same thing, like destroying a building using a missile versus using lava...

> How can either suddenly "get better"? We tell the cop net it got fooled and we know it is generated, not real image. Or tell the scammer it got caught, didn't fool the other net. But telling either of them this is saying that the image could be better, mr. thief, or the cop's understanding of what is better could be better, mr. cop! Same thing! And, telling them this doesn't tell them HOW to make the image better! You NEED to have references! So in the end a single network gets better by trying to recreate the original images using the least needed training i.e. you are good at predicting reality / future questions never seen before using just a little bit of the past.

Prove me wrong.

Reading this one link here and it's nonsense as usual.
https://towardsdatascience.com/how-gans-really-work-2e1db1f407bb
One part though says:
"We want to generate new samples, new situations which describe the same high-level features as X. And that%u2019s exactly what networks does : we use their weakness for our profit."
hmm.....
Emergent          https://openai.com/blog/

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: GANs are not novel I think
« Reply #1 on: August 16, 2020, 09:31:46 pm »
i found below it says in an article:
"In order to train the generator, the discriminator have to tell the generator how to tweak that generated image to be more realistic.

The generator must ask for suggestions from the discriminator!

Intuitively, the discriminator tells how much to tweak each pixel in order to make the image a little bit more realistic.

Technically, you do that by back-propagating the gradients of the discriminator’s output with respect to the generated image. That way, you will have gradients tensor that have the same shape as the image.

If you add these gradients to the generated image, it will make the image more realistic (in the discriminator’s eyes).

But we are not just going to add these gradients to the image.

Instead, we will back-propagate these image gradients further into all the weights that made up the generator so that the generator learns how to generate this new image."
Emergent          https://openai.com/blog/

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: GANs are not novel I think
« Reply #2 on: August 16, 2020, 10:51:46 pm »
not sure what you mean but I propose another way to do what GANs do, without a 2nd net. What you need do is take your existing net and look at which tree branches (think trie, markov chain) don't have enough statistics, and tell it it needs to tweak that branch or collect more data. For example 2 letter branch in a trie for text would be observing aa, ab, af, aa, zu, aa, aa, aq, aa.....and here we see aa is common, and we may not need to see any more 2 letter features because we see the trend now, but 66 letters we don't yet ex. hdfherdf.......zzzhdqwwoi.....no reoccurences yet here....

cus i mean, all a GAN can do is either say tweak the net or where to tweak it, which is equivalent to saying collect more data or collect specific data......otherwise a GAN would need to do some other function like Backoff or Semantics i.e. introduce other means to improve the net, not just tell it where it's generated image is lacking. See my book from last month version to get what i mean:
Emergent          https://openai.com/blog/

 


Requirements for functional equivalence to conscious processing?
by DaltonG (General AI Discussion)
November 19, 2024, 11:56:05 am
Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

446 Guests, 0 Users

Most Online Today: 467. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles