Making Sense of Neural Networks

  • 4 Replies
  • 1585 Views
*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1365
  • Humans will disappoint you.
    • Home Page
Making Sense of Neural Networks
« on: March 07, 2018, 01:46:22 am »
https://distill.pub/2018/building-blocks/

This is a really great article about how to make sense of what is actually going on inside a neural network.

"With the growing success of neural networks, there is a corresponding need to be able to explain their decisions — including building confidence about how they will behave in the real-world, detecting model bias, and for scientific curiosity. In order to do so, we need to both construct deep abstractions and reify (or instantiate) them in rich interfaces."

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Making Sense of Neural Networks
« Reply #1 on: March 07, 2018, 05:51:27 am »
http://playground.tensorflow.org

All the newcomers only need to know a few things to get the idea of ANNs. It's a shared-feature hierarchy that re-uses features like curves and noses. First it detects lines/curve types, and depending on which are more important it has learned or how many are present, it will activate maybe a nose and eyes in the next layer, then finally a face in the next layer. Same for anything you recognize in your day. This is Discrimination/classification. Generation is the opposite way - top-down. Look up GANs. They are incredibly useful. You select say a bedroom and it creates as high of resolution images you desire that are new and as asked for even by sentence input and can even predict next frames to generate video.
Emergent          https://openai.com/blog/

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1365
  • Humans will disappoint you.
    • Home Page
Re: Making Sense of Neural Networks
« Reply #2 on: March 07, 2018, 10:54:31 am »
Yes Locksuit that is as good an explanation of how they work as any, however it is missing the point of this particular article.

The new research is concerned with how to identify (reify or name) the elements that the neural network is using. We understand how neural networks are doing what they do, but to trust them we need to understand what they are doing in each instance as well. There should be a way to prove that it is correct in a language that we understand.

There is another important aspect to this as well. Neural networks require vast amounts of training data and computation, putting their creation out of the reach of people with limited resources. Maybe this form of analysis would allow neural networks to be programmed rather than taught, and maybe even achieve something that animals can do easily, which is learn from a single example.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Making Sense of Neural Networks
« Reply #3 on: March 07, 2018, 12:32:49 pm »
Don't we alrady have a way to see that it is learning+what it's learning during training? We have it Generate samples during training.

Also what about this?:
https://vimeo.com/228263798

Also does the nodes in the link below show images of what each neuron is seeing? Look closely at the nodes. It shows you what they have learned.
http://playground.tensorflow.org
Emergent          https://openai.com/blog/

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1365
  • Humans will disappoint you.
    • Home Page
Re: Making Sense of Neural Networks
« Reply #4 on: March 07, 2018, 09:45:45 pm »
You're right about already being able to see what's going on inside the neural network, but seeing and understanding are different things. The goal of the work in the original article is to assign meaning and condense everything down to a scale that is comprehensible by mere humans. For example they isolate the internal elements that allow a neural network to detect floppy ears and all their variations. The techniques that you describe are combined with a variety of methods to accomplish that goal.

Edit: keghn posted a good video that accompanies the article over here http://aidreams.co.uk/forum/index.php?topic=12802.msg51110#msg51110
« Last Edit: March 07, 2018, 11:11:19 pm by infurl »

 


OpenAI Speech-to-Speech Reasoning Demo
by ivan.moony (AI News )
Today at 01:31:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

312 Guests, 1 User
Users active in past 15 minutes:
squarebear
[Trusty Member]

Most Online Today: 346. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles