[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 483: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/includes/bbcode.php on line 112: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead
[phpBB Debug] PHP Warning: in file [ROOT]/feed.php on line 173: Cannot modify header information - headers already sent by (output started at [ROOT]/includes/functions.php:3823)
[phpBB Debug] PHP Warning: in file [ROOT]/feed.php on line 174: Cannot modify header information - headers already sent by (output started at [ROOT]/includes/functions.php:3823)
Parallella Community Supercomputing for Everyone 2017-10-22T01:22:34+00:00 https://parallella.org/forums/feed.php?f=23&t=4233 2017-10-22T01:22:34+00:00 2017-10-22T01:22:34+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19867#p19867 <![CDATA[Re: Multi-core Neural Net Engine]]> http://ieeexplore.ieee.org/abstract/document/7726118/

Statistics: Posted by dobkeratops — Sun Oct 22, 2017 1:22 am


]]>
2017-10-06T13:18:10+00:00 2017-10-06T13:18:10+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19810#p19810 <![CDATA[Re: Multi-core Neural Net Engine]]>
Yes it can "run C" .. but it can't re-use the overall approaches seen in existing CPU source code (push with DMA, vs pull from random sources via pointers etc).. I saw this with CELL , starting with code from other platforms was a disaster..

it's probably better to start just with convolutions, then figure out how to do those efficiently (i.e. how to tile across the cores.. has anyone done this yet?), then extend it to *multi-feature* convolutions. Just do image processing examples.
(the function I see in PAL is just 'single channel.. you might be able to adapt it with interleaving, or it might be better to code multi-channels specifically), then use that as a primitive for running 'forward inference' for convolutional nets.. just try to use a net already trained on a GPU.
(As I mentioned , it *is* then possible to express the back-propogation calculation for conv-nets using convolution operations.)

(are there implementations of edge-detector algorithms for the e-cores?)

Vision nets take a long time to train (hours, days .. weeks... ) can you imagine how much hell you're in for if you're starting out with a device performing 10x as slow (hous/days/weeks become days/weeks/months) .. far better to train the net on your PC GPU, or get one ready trained.

I suppose you could look at a scaled down example, e.g digit recognition , with the assumption that you could increase the layers to deal with more elaborate vision examples later

Statistics: Posted by dobkeratops — Fri Oct 06, 2017 1:18 pm


]]>
2017-10-06T12:33:22+00:00 2017-10-06T12:33:22+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19809#p19809 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by dobkeratops — Fri Oct 06, 2017 12:33 pm


]]>
2017-10-06T08:24:36+00:00 2017-10-06T08:24:36+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19808#p19808 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by claudio4parallella — Fri Oct 06, 2017 8:24 am


]]>
2017-10-06T02:27:06+00:00 2017-10-06T02:27:06+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19807#p19807 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by dobkeratops — Fri Oct 06, 2017 2:27 am


]]>
2017-10-06T02:56:25+00:00 2017-10-06T01:03:40+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19806#p19806 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by dobkeratops — Fri Oct 06, 2017 1:03 am


]]>
2017-10-05T16:31:06+00:00 2017-10-05T16:31:06+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19805#p19805 <![CDATA[Re: Multi-core Neural Net Engine]]> THE MODEL

Hi! I'm building up a configurable NN per Core and I'd like to get suggestions from you experts about the possible "Model".
I'm imaging and testing different se up that I'll try to list here into words.

MODEL0: pre convolution of big matrix (images for example) could be made in parallel by the multicore frame to be faster (only the starting convolution phase);
MODEL1: One NN per Core: each Core-NN could be trained and do its duty indipendently. Multicore=Multiduty.
MODEL2: Each Core-NN is trained for the same duty and they work in parallel each one dedicated to a part of the total of inputs (the total of an image is divided into 16 rectangles, each one treated by each core-NN for example to look for a face)
MODEL3: Each Core-NN is trained to do one duty regarding the same input (an image for example) and in parallel the first is detecting Face, the second is detecting cats, the third is detecting dogs..... the last one is detecting characters....
MODEL4: only tha Matrix Algebra for big matrix is parallelized among the cores in order to provide the training faster or working for detection faster
MODEL5: each core could be used in parallel to test different combinations of layers of the NN to realize the more efficient training, with same input and output to be verified

Which is the model that could be of any value up to you for such a MultiCore Board, considering the fact that the elaboration is sequential layer by layer from Input to Output in a continuous loop to reduce the error?

Thanks for your considerations

Statistics: Posted by claudio4parallella — Thu Oct 05, 2017 4:31 pm


]]>
2017-09-30T09:41:43+00:00 2017-09-30T09:41:43+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19790#p19790 <![CDATA[Re: Multi-core Neural Net Engine]]>
and I was just thinking, for robot control, would you want to minimize latency? so you'd always want to parallelize across each layer as much as possible first?..

(I was going to say extending the post above there'd be the option of splitting network layers across different cores.. but that would prioritise throughput over latency?)

Statistics: Posted by dobkeratops — Sat Sep 30, 2017 9:41 am


]]>
2017-09-29T14:27:36+00:00 2017-09-29T14:27:36+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19786#p19786 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by jar — Fri Sep 29, 2017 2:27 pm


]]>
2017-09-29T11:16:08+00:00 2017-09-29T11:16:08+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19785#p19785 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by dobkeratops — Fri Sep 29, 2017 11:16 am


]]>
2017-09-29T05:46:31+00:00 2017-09-29T05:46:31+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19784#p19784 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by jar — Fri Sep 29, 2017 5:46 am


]]>
2017-09-28T20:16:55+00:00 2017-09-28T20:16:55+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19780#p19780 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by dobkeratops — Thu Sep 28, 2017 8:16 pm


]]>
2017-10-07T13:24:30+00:00 2017-09-28T19:39:13+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19777#p19777 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by claudio4parallella — Thu Sep 28, 2017 7:39 pm


]]>
2017-09-28T19:10:42+00:00 2017-09-28T19:10:42+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19775#p19775 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by jar — Thu Sep 28, 2017 7:10 pm


]]>
2017-09-28T12:24:22+00:00 2017-09-28T12:24:22+00:00 https://parallella.org/forums/viewtopic.php?t=4233&p=19774#p19774 <![CDATA[Re: Multi-core Neural Net Engine]]> Statistics: Posted by dobkeratops — Thu Sep 28, 2017 12:24 pm


]]>