Biology-inspired neuron and biology-simulated neuron

  • 4 Replies
  • 1360 Views
*

Dee

  • Nomad
  • ***
  • 94
  • AI rocks!
Biology-inspired neuron and biology-simulated neuron
« on: January 26, 2020, 02:53:21 am »
What we are doing presently with ANN are working with biology-inspired neurons that is the neurons are not much like biological neurons, only some inputs (dendrites), dot (soma), and output activation (axon terminal).

In reality of biological neurons, they are supposed to be much more complex with dendrite combinations (like xi+xj before multiplication with weight), soma functions, and multiple axon outputs of similar values, etc.

Should artificial neurons ever be bio-simulated instead of bio-inspired?

*

HS

  • Trusty Member
  • **********
  • Millennium Man
  • *
  • 1178
Re: Biology-inspired neuron and biology-simulated neuron
« Reply #1 on: January 26, 2020, 03:37:02 am »
Regarding artificial general intelligence (AGI), currently yes. It seems like we’re still at a level of knowledge/understanding where we’ll learn best by imitating nature’s fully functional systems. Once we get a grasp of the principles, it will be easier to create something familiar yet augmented, which seems to be the predominant goal. The "out there" approaches are cool and exciting, just probably a safer bet for hobbyists.

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1372
  • Humans will disappoint you.
    • Home Page
Re: Biology-inspired neuron and biology-simulated neuron
« Reply #2 on: January 26, 2020, 04:17:00 am »
Should artificial neurons ever be bio-simulated instead of bio-inspired?

There have been attempts to simulate neurons at the biological level but the world's computing resources are not adequate to do this on more than a rudimentary scale. Each neuron is more than just a logic gate or a memory bit, it's an entire computer system, and the brain consists of a network of billions of them. Not only that, it's incredibly efficient. A human brain uses about 25 watts of power and yet all the computers in the world can't match its computational power.

On the other hand, Jeff Hawkins and his team at Numenta believe they have identified the essential elements of neurons and the data structures that they represent. They call this hierarchical temporal memory (HTM) and they've published quite a lot of information about it. Check out Numenta's YouTube channel and other sources for more details. They have working hardware and software that is bio-inspired as a result of this research.

https://numenta.org/

*

Dee

  • Nomad
  • ***
  • 94
  • AI rocks!
Re: Biology-inspired neuron and biology-simulated neuron
« Reply #3 on: January 26, 2020, 05:52:37 pm »
Regarding artificial general intelligence (AGI), currently yes. It seems like we’re still at a level of knowledge/understanding where we’ll learn best by imitating nature’s fully functional systems. Once we get a grasp of the principles, it will be easier to create something familiar yet augmented, which seems to be the predominant goal. The "out there" approaches are cool and exciting, just probably a safer bet for hobbyists.

Most of the base maths and mechanism for ML were done in the last century, with some types of neurons: basic dense, convo, rnn, lstm, etc.
Hopefully in this century some guys will invent more complex neuron types.

*

Dee

  • Nomad
  • ***
  • 94
  • AI rocks!
Re: Biology-inspired neuron and biology-simulated neuron
« Reply #4 on: January 26, 2020, 06:07:18 pm »
Should artificial neurons ever be bio-simulated instead of bio-inspired?

There have been attempts to simulate neurons at the biological level but the world's computing resources are not adequate to do this on more than a rudimentary scale. Each neuron is more than just a logic gate or a memory bit, it's an entire computer system, and the brain consists of a network of billions of them. Not only that, it's incredibly efficient. A human brain uses about 25 watts of power and yet all the computers in the world can't match its computational power.

On the other hand, Jeff Hawkins and his team at Numenta believe they have identified the essential elements of neurons and the data structures that they represent. They call this hierarchical temporal memory (HTM) and they've published quite a lot of information about it. Check out Numenta's YouTube channel and other sources for more details. They have working hardware and software that is bio-inspired as a result of this research.

https://numenta.org/

The 25 watts fact is interesting :) and the billions of neurons may ever be simulated using quantum computers as quantum computers work on particle scale, states of particles. However, it's still far ahead to think of doing something with quantum machines popularly since  IBM only released the first commercial IBM Q System One last year :)

The HTM seems promising that even LSTM by now only stores 1 or 2 inputs of the most recent past and future.

 


Requirements for functional equivalence to conscious processing?
by DaltonG (General AI Discussion)
November 19, 2024, 11:56:05 am
Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

377 Guests, 0 Users

Most Online Today: 532. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles