Ai Dreams Forum

Member's Experiments & Projects => AI Programming => Topic started by: raf on February 06, 2013, 07:59:49 pm

Title: design neural network for learning numbers
Post by: raf on February 06, 2013, 07:59:49 pm

How do I design in words ( step by step)  neural network that learns number [0-9]? Could someone explain?

Title: Re: design neural network for learning numbers
Post by: Bragi on February 07, 2013, 07:21:50 am

Learns what about numbers? Recognize written numbers on paper or something else?

Title: Re: design neural network for learning numbers
Post by: raf on February 07, 2013, 11:39:02 am

Learns numbers from a tab6x6 ( tab contains  0 and 1. 0 is an empty field,  1s make up a number). What would look the process of designin such a network (step by step including calculating neuron, layers etc)? Thanks in advanced.

Title: Re: design neural network for learning numbers
Post by: Bragi on February 07, 2013, 01:30:45 pm

I'm a little confused by the 6*6 grid. Do you mean something like this, which would be the nr 3:

Code

1111
0001
1111
0001
1111

I'd build a decision tree, like so: http://bragisoft.com/2013/02/creating-and-using-decision-trees/ (http://bragisoft.com/2013/02/creating-and-using-decision-trees/)

Title: Re: design neural network for learning numbers
Post by: raf on February 07, 2013, 02:26:46 pm

Yeah, that what I mean, But the grid is 6X6 not 4x5. The problem is that I am really new in this and I am not familiar enough with decision tree to give it a try. So lets focus on the grid. To be honest that was an exam question to desing a NN that recognizes numbers.  If you could help me, how would you answer the question ( how would you desing the network)?

Title: Re: design neural network for learning numbers
Post by: Bragi on February 07, 2013, 04:34:38 pm

Well, how far did you get?

Title: Re: design neural network for learning numbers
Post by: raf on February 07, 2013, 04:44:50 pm

Well for me its obv that this network should have 36 inputs , 10 outputs ( numbers from 0 to 9)  and 2 hidden layers ( guessing). And it could use Sigmoid funcion for calculating the neurons output. Trained with back propagation rules. Thats all i can write;

How do i know kow many neurons should I have in every layer?
What can i write more?

Title: Re: design neural network for learning numbers
Post by: Bragi on February 07, 2013, 05:54:26 pm

Ahh, that's the tricky bit. Trial and error, training functions,..

Title: Re: design neural network for learning numbers
Post by: raf on February 07, 2013, 08:03:21 pm

could you answer in more detail?

Title: Re: design neural network for learning numbers
Post by: Ben.F.Rayfield on February 13, 2014, 04:19:28 am

You should be able to learn bit patterns using SimpleRBM which is where I started learning about Boltzmann Machines and then wrote in enough technical detail here http://aidreams.co.uk/forum/index.php?topic=5990.0 (http://aidreams.co.uk/forum/index.php?topic=5990.0) ("Ben F Rayfield - My bizarre research toward networking minds together") how you can build one from scratch, train, and use it in realtime.