Biology-inspired neuron and biology-simulated neuron

  • 4 Replies
  • 1068 Views
*

Dee

  • Nomad
  • ***
  • 94
  • AI rocks!
Biology-inspired neuron and biology-simulated neuron
« on: January 26, 2020, 02:53:21 am »
What we are doing presently with ANN are working with biology-inspired neurons that is the neurons are not much like biological neurons, only some inputs (dendrites), dot (soma), and output activation (axon terminal).

In reality of biological neurons, they are supposed to be much more complex with dendrite combinations (like xi+xj before multiplication with weight), soma functions, and multiple axon outputs of similar values, etc.

Should artificial neurons ever be bio-simulated instead of bio-inspired?

*

HS

  • Trusty Member
  • **********
  • Millennium Man
  • *
  • 1175
Re: Biology-inspired neuron and biology-simulated neuron
« Reply #1 on: January 26, 2020, 03:37:02 am »
Regarding artificial general intelligence (AGI), currently yes. It seems like we’re still at a level of knowledge/understanding where we’ll learn best by imitating nature’s fully functional systems. Once we get a grasp of the principles, it will be easier to create something familiar yet augmented, which seems to be the predominant goal. The "out there" approaches are cool and exciting, just probably a safer bet for hobbyists.

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1365
  • Humans will disappoint you.
    • Home Page
Re: Biology-inspired neuron and biology-simulated neuron
« Reply #2 on: January 26, 2020, 04:17:00 am »
Should artificial neurons ever be bio-simulated instead of bio-inspired?

There have been attempts to simulate neurons at the biological level but the world's computing resources are not adequate to do this on more than a rudimentary scale. Each neuron is more than just a logic gate or a memory bit, it's an entire computer system, and the brain consists of a network of billions of them. Not only that, it's incredibly efficient. A human brain uses about 25 watts of power and yet all the computers in the world can't match its computational power.

On the other hand, Jeff Hawkins and his team at Numenta believe they have identified the essential elements of neurons and the data structures that they represent. They call this hierarchical temporal memory (HTM) and they've published quite a lot of information about it. Check out Numenta's YouTube channel and other sources for more details. They have working hardware and software that is bio-inspired as a result of this research.

https://numenta.org/

*

Dee

  • Nomad
  • ***
  • 94
  • AI rocks!
Re: Biology-inspired neuron and biology-simulated neuron
« Reply #3 on: January 26, 2020, 05:52:37 pm »
Regarding artificial general intelligence (AGI), currently yes. It seems like we’re still at a level of knowledge/understanding where we’ll learn best by imitating nature’s fully functional systems. Once we get a grasp of the principles, it will be easier to create something familiar yet augmented, which seems to be the predominant goal. The "out there" approaches are cool and exciting, just probably a safer bet for hobbyists.

Most of the base maths and mechanism for ML were done in the last century, with some types of neurons: basic dense, convo, rnn, lstm, etc.
Hopefully in this century some guys will invent more complex neuron types.

*

Dee

  • Nomad
  • ***
  • 94
  • AI rocks!
Re: Biology-inspired neuron and biology-simulated neuron
« Reply #4 on: January 26, 2020, 06:07:18 pm »
Should artificial neurons ever be bio-simulated instead of bio-inspired?

There have been attempts to simulate neurons at the biological level but the world's computing resources are not adequate to do this on more than a rudimentary scale. Each neuron is more than just a logic gate or a memory bit, it's an entire computer system, and the brain consists of a network of billions of them. Not only that, it's incredibly efficient. A human brain uses about 25 watts of power and yet all the computers in the world can't match its computational power.

On the other hand, Jeff Hawkins and his team at Numenta believe they have identified the essential elements of neurons and the data structures that they represent. They call this hierarchical temporal memory (HTM) and they've published quite a lot of information about it. Check out Numenta's YouTube channel and other sources for more details. They have working hardware and software that is bio-inspired as a result of this research.

https://numenta.org/

The 25 watts fact is interesting :) and the billions of neurons may ever be simulated using quantum computers as quantum computers work on particle scale, states of particles. However, it's still far ahead to think of doing something with quantum machines popularly since  IBM only released the first commercial IBM Q System One last year :)

The HTM seems promising that even LSTM by now only stores 1 or 2 inputs of the most recent past and future.

 


OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 15, 2024, 08:14:02 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm
AI-Generated Art Cannot Receive Copyrights
by frankinstien (AI News )
August 24, 2023, 08:49:45 am

Users Online

166 Guests, 0 Users

Most Online Today: 248. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles