Neural Network

Re: Neural Network

Postby censix » Wed Oct 09, 2013 11:46 am

... All that aside, I think that the parallella is cool and a feed forward, back propagation neural network is the only algorithm that I know that would seem to benefit from being written for it, so that's the one I'm doing.

nick



Fully agree!
censix
 
Posts: 49
Joined: Sun Dec 16, 2012 7:54 pm
Location: europe

Re: Neural Network

Postby nickoppen » Mon Dec 02, 2013 6:13 am

Hello,

While we are waiting, I thought I'd use the time to update my old, Windows/MFC neural network library so that it runs on a platform that is a little more generic.

My initial intention was to update the interface classes to use the C++ standard library that runs on the Raspberry Pi given that the Pi is the most similar system I have to the parallella. I found it hard to stop there so I got the whole thing going and added a number of upgrades. It is all very C++-like and as such not at all suitable for the parallella. The next branch will be a more matrix oriented approach that is based on the design outlined in my blog pages (https://www.blogger.com/blogger.g?blogID=6502986659663340614#allposts).

Anyway, I've loaded it all up to a git repository (https://github.com/nickoppen/eNNpi.git). I use Eclipse and egit and given the amount of fumbling around I've done to get all of the stuff loaded there, I profess to be a complete git ignoramus. "All" actually means "almost all" given that I've not yet managed to upload the most interesting data set, the Shuttle Statlog. I'm still working on that.

If you have a Linux system and can nut your way around git please give it a try and post any feedback on the Feedback... Post it here wiki page in the repository.

Cheers,

nick
Sharing is what makes the internet Great!
User avatar
nickoppen
 
Posts: 266
Joined: Mon Dec 17, 2012 3:21 am
Location: Sydney NSW, Australia

Re: Neural Network

Postby aolofsson » Mon Dec 02, 2013 11:11 pm

Nick,
This is really cool. Thanks for staying with us through all these inctedibly frustrating delays. Can't wait to see how epiphany performs on neural networks once hardware hits the street!
Andreas
User avatar
aolofsson
 
Posts: 1005
Joined: Tue Dec 11, 2012 6:59 pm
Location: Lexington, Massachusetts,USA

Re: Neural Network

Postby nickoppen » Sun Dec 08, 2013 10:30 am

nickoppen wrote:
I've not yet managed to upload the most interesting data set, the Shuttle Statlog.



I just managed to get the Shuttle Statlog data uploaded. There are four training sets and one test set, the original data and transformed data in an open office spreadsheet and two scripts, one for create/train/save and one for test.
Sharing is what makes the internet Great!
User avatar
nickoppen
 
Posts: 266
Joined: Mon Dec 17, 2012 3:21 am
Location: Sydney NSW, Australia

Re: Neural Network

Postby aolofsson » Mon Jul 14, 2014 8:51 am

nickoppen,
Now that you have the Parallella in your hands, what are your thoughts on running NN on it? Is it what you expected?
Look forward to your thoughts.
Andreas
User avatar
aolofsson
 
Posts: 1005
Joined: Tue Dec 11, 2012 6:59 pm
Location: Lexington, Massachusetts,USA

Re: Neural Network

Postby Cyberman.ff » Sat Jul 19, 2014 8:09 pm

Thanks this is helpful for some of what I was trying to think through.

The training part has been my big "how is that going to happen" issue. It's a highly asymetric process.
Cyberman.ff
 
Posts: 5
Joined: Tue Jul 08, 2014 10:28 pm

Re: Neural Network

Postby Gerald » Sun Aug 10, 2014 2:50 pm

Gerald
 
Posts: 22
Joined: Thu Mar 21, 2013 10:43 am

Re: Neural Network

Postby petewarden » Mon Aug 11, 2014 5:07 pm

Thanks for posting a link to my work! I actually just registered here to get a sense of how hard it would be to port the framework to the Parallela board. The bulk of the time is spent on a series of massive matrix multiplies, so I was wondering if there was a version of the BLAS GEMM function that had been optimized for the hardware?
petewarden
 
Posts: 1
Joined: Mon Aug 11, 2014 5:02 pm

Re: Neural Network

Postby aolofsson » Mon Aug 11, 2014 5:37 pm

petewarden,

Nice work with the pi!

Unfortunately there hasn't been an official BLAS library completed yet.:-(

Take a look at the following example showing how it could be scaled out.

https://github.com/adapteva/epiphany-ex ... /matmul-16

What size matrices are you working with?

Andreas
User avatar
aolofsson
 
Posts: 1005
Joined: Tue Dec 11, 2012 6:59 pm
Location: Lexington, Massachusetts,USA

Re: Neural Network

Postby Gerald » Thu Aug 14, 2014 1:42 pm

@petewarden: oh you are here too :D ...how much speedup do you expect when running it on the Parallella? how much would be the speedup compared to a cuda/gpu version?
Gerald
 
Posts: 22
Joined: Thu Mar 21, 2013 10:43 am

PreviousNext

Return to Artificial Intelligence

Who is online

Users browsing this forum: No registered users and 0 guests

cron