From: Rok Sibanc (rok.sibanc@gmail.com)
Date: Tue Jan 24 2006 - 15:05:10 MST
1 million neurons/second... beacause every neuron has to do multiplication
of every incoming input and sumation of all weighted inputs and finally
sigmoid function which is expressed with taylor's polynomial.
to sum up: neuron update is dependant on number of inputs and activation
function type.
Rok
On 1/24/06, Russell Wallace <russell.wallace@gmail.com> wrote:
>
> On 1/12/06, CyTG <cytg.net@gmail.com> wrote:
> >
> > On my machine, a 3GHz workstation, im able to run a feedforward network
> > at about 150.000 operations /second WITH training(backprop) .. take
> > training out of the equation and we may, lets shoot high, land on 1 million
> > 'touched' neurons/second
>
>
> I'm curious: in most artificial "neural nets" the basic operation is dot
> product of input and weight vectors, with some function e.g. sigmoid on
> the final output - 2 flops per connection. What are you doing that's taking
> a thousand times longer?
>
> - Russell
>
This archive was generated by hypermail 2.1.5 : Wed Jul 17 2013 - 04:00:55 MDT