efficiency breakthrough via mathematics

  • 2 Replies
  • 69904 Views
*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1365
  • Humans will disappoint you.
    • Home Page
efficiency breakthrough via mathematics
« on: October 13, 2020, 03:02:18 am »
https://techxplore.com/news/2020-10-breakthrough-energy-efficient-artificial-intelligence.html

This seems like something to get excited about.

Quote
Thanks to a mathematical breakthrough, AI applications like speech recognition, gesture recognition and ECG classification can become a hundred to a thousand times more energy efficient. This means it will be possible to put much more elaborate AI in chips, enabling applications to run on a smartphone or smartwatch where before this was done in the cloud.

Quote
Under supervision of CWI researcher and UvA professor cognitive neurobiology Sander Bohté, researchers developed a learning algorithm for so-called spiking neural networks. Such networks have been around for some time, but are very difficult to handle from a mathematical perspective, making it hard to put them into practice so far. The new algorithm is groundbreaking in two ways: the neurons in the network are required to communicate a lot less frequently, and each individual neuron has to execute fewer calculations.

*

HS

  • Trusty Member
  • **********
  • Millennium Man
  • *
  • 1175
Re: efficiency breakthrough via mathematics
« Reply #1 on: October 13, 2020, 08:53:42 pm »
I don't have much of a frame of reference. Is this comparable to AC/DC currents, with the non continuous math wasting less energy on unnecessary things? Is it more like only pedaling uphill, and coasting the rest of the time? Could those analogue neurons from the "Memristor Breakthrough" (picture below) be made to approximate this style of function, where they pick their moments to communicate? Can any mathematical formula be created as an analogue structure? Interesting stuff.


Mz-Y5-Nz-U3-MA" border="0

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1365
  • Humans will disappoint you.
    • Home Page
Re: efficiency breakthrough via mathematics
« Reply #2 on: October 14, 2020, 09:47:44 am »
A closer analogy might be like the difference between switching and linear amplifiers or power regulators, but what it amounts to is not wasting energy on things that aren't changing, just responding to events and remaining at rest when nothing is happening. That would be complicated to model mathematically, much like integer programming is much more complicated than linear programming in operations research.

https://en.wikipedia.org/wiki/Integer_programming

 


OpenAI Speech-to-Speech Reasoning Demo
by ivan.moony (AI News )
March 28, 2024, 01:31:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

300 Guests, 0 Users

Most Online Today: 396. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles