efficiency breakthrough via mathematics

  • 2 Replies
  • 82547 Views
*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
efficiency breakthrough via mathematics
« on: October 13, 2020, 03:02:18 am »
https://techxplore.com/news/2020-10-breakthrough-energy-efficient-artificial-intelligence.html

This seems like something to get excited about.

Quote
Thanks to a mathematical breakthrough, AI applications like speech recognition, gesture recognition and ECG classification can become a hundred to a thousand times more energy efficient. This means it will be possible to put much more elaborate AI in chips, enabling applications to run on a smartphone or smartwatch where before this was done in the cloud.

Quote
Under supervision of CWI researcher and UvA professor cognitive neurobiology Sander Bohté, researchers developed a learning algorithm for so-called spiking neural networks. Such networks have been around for some time, but are very difficult to handle from a mathematical perspective, making it hard to put them into practice so far. The new algorithm is groundbreaking in two ways: the neurons in the network are required to communicate a lot less frequently, and each individual neuron has to execute fewer calculations.

*

HS

  • Trusty Member
  • **********
  • Millennium Man
  • *
  • 1177
Re: efficiency breakthrough via mathematics
« Reply #1 on: October 13, 2020, 08:53:42 pm »
I don't have much of a frame of reference. Is this comparable to AC/DC currents, with the non continuous math wasting less energy on unnecessary things? Is it more like only pedaling uphill, and coasting the rest of the time? Could those analogue neurons from the "Memristor Breakthrough" (picture below) be made to approximate this style of function, where they pick their moments to communicate? Can any mathematical formula be created as an analogue structure? Interesting stuff.


Mz-Y5-Nz-U3-MA" border="0

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1371
  • Humans will disappoint you.
    • Home Page
Re: efficiency breakthrough via mathematics
« Reply #2 on: October 14, 2020, 09:47:44 am »
A closer analogy might be like the difference between switching and linear amplifiers or power regulators, but what it amounts to is not wasting energy on things that aren't changing, just responding to events and remaining at rest when nothing is happening. That would be complicated to model mathematically, much like integer programming is much more complicated than linear programming in operations research.

https://en.wikipedia.org/wiki/Integer_programming

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

335 Guests, 0 Users

Most Online Today: 349. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles