Help with Neural Network problem

  • 12 Replies
  • 4303 Views
*

Haemp

  • Roomba
  • *
  • 2
Help with Neural Network problem
« on: June 23, 2012, 04:46:47 am »
Hi guys,

I'm building an application for Android devices that requires it to recognize, by accelerometer data, the difference between walking noise and double tapping it. I'm trying to solve this problem using Neural Networks.

At the start it went pretty well, teaching it to recognize the taps from noise such as standing up/ sitting down and walking around at a slower pace. But when it came to normal walking it never seemed to learn even though I fed it with a large proportion of noise data.

My question: Are there any serious flaws in my approach? Is the problem based on lack of data?

The network
I've choosen a 25 input 1 output multi-layer perceptron, which I am training with backpropagation. The input is the changes in acceleration every 20ms and output ranges from -1 (for no-tap) to 1 (for tap). I've tried pretty much every constallation of hidden inputs there are, but had most luck with 3 - 10.

I'm using Neuroph's easyNeurons for the training and exporting to Java.

The data
My total training data is about 50 pieces double taps and about 3k noise. But I've also tried to train it with proportional amounts of noise to double taps.

The data looks like this (ranges from +10 to -10):

Sitting double taps: http://i.stack.imgur.com/a7PDT.png

Fast walking: http://i.stack.imgur.com/ljRwp.png

So to reiterate my questions: Are there any serious flaws in my approach here? Do I need more data for it to recognize the difference between walking and double tapping? Any other tips?

*

Bragi

  • Trusty Member
  • ********
  • Replicant
  • *
  • 564
    • Neural network design blog
Re: Help with Neural Network problem
« Reply #1 on: June 23, 2012, 07:40:33 am »
Which data exactly are you feeding the neural net: the raw audio samples, or do you first convert them with a FFT or something similar?
Have you ever taken a look at beat recognition algorithms? It sounds like a similar operation.

*

Haemp

  • Roomba
  • *
  • 2
Re: Help with Neural Network problem
« Reply #2 on: June 23, 2012, 11:24:43 am »
Thanks for the recommendation but its not sound, its accelerometer data, but I guess it looks like sound. I googled around for a Beat recognition library for Java, but couldn't find any - do you know of any?


*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Help with Neural Network problem
« Reply #4 on: June 25, 2012, 12:28:52 pm »
That link seems to go nowhere Bragi  ???

*

Bragi

  • Trusty Member
  • ********
  • Replicant
  • *
  • 564
    • Neural network design blog
Re: Help with Neural Network problem
« Reply #5 on: June 25, 2012, 01:23:48 pm »
doesn't it open a pdf file for you? (it does for me)

*

Data

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1279
  • Overclocked // Undervolted
    • Datahopa - Share your thoughts ideas and creations
Re: Help with Neural Network problem
« Reply #6 on: June 25, 2012, 01:27:19 pm »
Yes it opens a PDF for me too, using IE9.

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Help with Neural Network problem
« Reply #7 on: June 25, 2012, 01:28:42 pm »
No, must be a Chrome thing I guess then..

*

Bragi

  • Trusty Member
  • ********
  • Replicant
  • *
  • 564
    • Neural network design blog
Re: Help with Neural Network problem
« Reply #8 on: June 25, 2012, 01:41:38 pm »
I'm using firefox.  I got the link from a google search. Strange. Maybe a security thing?

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Help with Neural Network problem
« Reply #9 on: June 25, 2012, 02:09:34 pm »
Maybe, don't know to be honest.

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: Help with Neural Network problem
« Reply #10 on: June 25, 2012, 04:46:32 pm »
Works for me in all save Chrome as well, Freddy. ???
In the world of AI, it's the thought that counts!

*

Data

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1279
  • Overclocked // Undervolted
    • Datahopa - Share your thoughts ideas and creations
Re: Help with Neural Network problem
« Reply #11 on: June 25, 2012, 04:56:43 pm »
What can I say, the number of things Chrome can’t do seems to be growing weekly.  ;D

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Help with Neural Network problem
« Reply #12 on: June 25, 2012, 05:44:04 pm »
Haha, still a long way before it catches up with IE though  >:D

 


Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
Attempting Hydraulics
by MagnusWootton (Home Made Robots)
August 19, 2024, 04:03:23 am
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

420 Guests, 0 Users

Most Online Today: 571. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles