1. Selection of Books on ANNs
2. General Information about ANNs
3. Tools for Training of ANNs
4. Neural Network Bibliographies and On-line Papers
5. Neural Network Performance Benchmarks
6. Courses
7. Sites with miscellaneous ANNs links and resources
8. Hardware Implementations of ANNs
9. ANN & FL Applications
10. Intelligent Control
11. Neural Network Research Groups
12. Independent Component Analysis
13. Support & Relevance Vector Machines
14. Reinforcement Learning

1. Selection of Books on Artificial Neural Networks

• Simon Haykin, Neural Networks: A Comprehensive Foundation,
  • 3rd edition "Neural Networks and Learning Machines" (Nov, 2008), Publisher: Prentice Hall; Format: Hardcover, ISBN-10: 0131471392 ISBN-13: 9780131471399, link
  • 2nd edition (Mar., 1999), Publisher: Prentice Hall; Format: Hardcover, ISBN-10: 0780334949 ISBN-13: 9780780334946, link
  • 2nd edition (July, 1998), Publisher: Prentice Hall; Format: Paperback, ISBN-10: 0139083855 ISBN-13: 9780139083853, link
• Robert J. Schalkoff, Artificial Neural Networks co-published by MIT Press and the McGraw-Hill Companies 1997, ISBN: 0-07-057118-X.
• J. M. Zurada, Introduction to Artificial Neural Systems - West Publishing Company 1992, ISBN: 0-314-93391-3.
• M. Hagan, H. Demuth, M. Beale, Neural Network Design, PWS Publishing Company 1995, ISBN: 0-534-94332-2.
  

Related more towards applications:

• CMOS. VLSI, MOSFET implementations: Pulsed Neural Networks, eds. Wolfgang Maass and Christopher M. Bishop, MIT Press 1998, ISBN: 0-262-13350-4 http://research.microsoft.com/~cmbishop/pulsed.htm
• ed. by Ian Cloete & Jacek M. Zurada, Knowledge-Based Neurocomputing, The MIT Press, 2000, ISBN: 0-262-03274-0.
• ed. by Emile Aarts, J.K.Lenstra, Local Search In Combinatorial Optimization, John Wiley & Sons, 1998, ISBN: 0-471-948-225.
• ed. by D.B. Fogel, C.J. Robinson, Computational Intelligence, John Wiley & Sons, IEEE Press, ISBN: 0-471-27454-2.
• Hagan, H. Demuth, M. Beale, "Neural Network Design", Martin Hagan , 2002, ISBN-10: 0971732108, ISBN-13: 978-0971732100
  • Hagan, H. Demuth, M. Beale, "Neural Network Design", PWS Publishing Company 1995, ISBN: 0-534-94332-2
• Mohamad H. Hassoun, Fundamentals of Artificial Neural Networks, MIT Press, 1995, ISBN: -262-08239-X, online graduate textbook: http://neuron.eng.wayne.edu/tarek/MITbook/t_contents.html
• David MacKay, Information Theory, Pattern Recognition and Neural Networks, (e-book), Hardcover, ISBN: 0521642981, 2003, Cambridge Univ Press link1 link2
• StatSoft, Electronic Textbook: http://www.statsoft.com/textbook/stneunet.html (great online reference)
• James A. Anderson, An Introduction to Neural Networks (Hardcover), Hardcover: 672 pages, Publisher: The MIT Press (March 16, 1995), ISBN-10: 0262011441, ISBN-13: 978-0262011440, link
• John Hertz, Anders Krogh, Richard G. Palmer, Introduction to the Theory of Neural Computation (Santa Fe Institute Studies in the Sciences of Complexity) (Paperback), Publisher: Perseus Books Group; New Ed edition (January 1991), ISBN-10: 0201515601, ISBN-13: 978-0201515602 link

Pattern recogntion

• Christopher M. Bishop, Pattern Recognition and Machine Learning, Springer (2006), Publisher: Springer; 1 edition (August 17, 2006), Language: English, ISBN-10: 0387310738, ISBN-13: 978-0387310732 link1 link2
• Christopher M. Bishop, Neural Networks for Pattern Recognition (Paperback), Paperback: 504 pages, Publisher: Oxford University Press, USA (January 18, 1996), ISBN-10: 0198538642, ISBN-13: 978-0198538646

up

2. General Information about Neural Networks

• For general information about neural networks, please consult the Neural Network FAQ.
• The following sites have many links to neural network information on the Web:
• http://www.emsl.pnl.gov:2080/docs/cie/neural/neural.homepage.html
• http://http2.brunel.ac.uk:8080/research/cnca/links.html
• For neural network software, mailing list archives, and other information, go to the CMU AI Repository (Neural Area).

up

3. Tools for Artificial Neural Network Training

• SNNS - Stuttgart Neural Network Simulator (free) for Linux, Solaris, Windows (JavaNNS)
• MathWorks Matlab Neural Network Toolbox http://www.mathworks.com/products/neuralnet/
• STATISTICA Neural Networks (in short, ST Neural Networks, a neural networks application available from StatSoft), a particularly comprehensive neural network tool http://www.statsoft.com/products/stat_nn.html
• NeuroSolutions http://www.neurosolutions.com/products/ns/
• Qnet v2000 - Neural Network Modeling for Windows http://www.qnetv2k.com/ (commercial, 30 day trial)
• NNOTT - http://husky.if.uidaho.edu/nn/ (free online tool running on this server)
• Java applets for ANN training (this server)
• For neural network software, mailing list archives, and other information, go to the CMU AI Repository (Neural Area).
• Matlab
  • Matlab documentation (User's Guides, etc.), available for free at Matlab Help Desk.
  • Student Edition of MATLAB Version 5 for Windows (Textbook Binding) by Mathworks, Mathworks Staff, MathWorks Inc. Prentice Hall; Bk&CD-Rom edition (April 28, 1997), Language: English, ISBN-10: 0132724774, ISBN-13: 978-0132724777 link1

up

4. Neural Network Bibliographies and On-line Papers

• For neural network citation and bibliography tracing, you can visit Citeseer.
• For neural network bibliographies, you can visit the following sites:
• The Collection of Computer Science Bibliographies (Neural Networks)
• Biblio (Search Tool for Neural Network Publications)
• The New Zealand Digital Library
• computing breinestorm paper search: http://computing.breinestorm.net/index.phtml


• Other sites have numerous on-line papers:
• Neuroprose Paper Archive
• NIPS 95 downloadable papers

• Neural Networks at your Fingertips: http://www.neural-networks-at-your-fingertips.com
• FAQs on neural network and data mining, answered by Warren Sarle from the SAS Institute ftp://ftp.sas.com/pub/neural/FAQ.html

There is a very good neural network conference that is held every year in Denver, called Advances in Neural Information Processing Systems (or "NIPS").

up

5. Neural Network Performance Benchmarks

• Testing neural networks on standard benchmarks is very important. For neural network benchmarks, you can visit these sites:
• LANS Benchmark Dataset Collection
• Lutz Prechelt's NN Benchmarking Page
• UCI Machine Learning benchmark collection
• CMU AI Repository (NNs Benchmarks)
• Delve benchmark collection
• NCRG Ric Lister's NN Databases
  • (MNIST database of handwritten characters , Santa Fe Time Series Competition data)

up

6. Courses

• Dr. Bogdan Wilamowski at UofA
• Dr. Kari Torkkola at ASU (benchmarks, journals, conferences, demos, software,...)
• Dr. Milos Manic at UofI
• NeuroSolutions Neural Network course: http://www.neurosolutions.com/products/course/

up

7. Sites with miscellaneous NN links and resources.

• Fun to read Eric Roberts' Sophomore College 2000 class: http://www-cse.stanford.edu/classes/sophomore-college/projects-00/neural-networks/index.html
• NCRG Ric Lister's (Books, Journals, Software, Databases, Archives, Newsgroups, misc., and other)
• Univ.of Oxford, Brian Ripley's talks (NIPS*95-6, bench's)

up

8. Hardware Implementations of Artificial Neural Networks

• Structure-Adaptable Digital Neural Networks, Ph.D thesis 1999 by Andres Perez-Uribe: http://www.geocities.com/fastiland/thesis/
• ABIONIN: Artificial BIOmorphic Neurocontrolled INsect: http://www.seattlerobotics.org/encoder/200205/abionin.htm
• Project: Neural Networks - Hardware Implementation, Ing. Miroslav Skrbek, Doc. Ing. Miroslav Snorek, CSc., 1991-2000 (reconfigurable neurochips)
• A hardware implementation of functional spiking neurons with hebbian learning...
• A Hardware Implementation of the Backpropagation Algorithm ...: splish.ee.byu.edu/docs/wcci94.rrann.ps
• A Reconfigurable SOM Hardware Accelerator: www.dice.ucl.ac.be/Proceedings/ esann/esannpdf/es2002-359.pdf
• Neural Networks in Hardware: Architectures, Products and Applications http://www.particle.kth.se/~lindsey/HardwareNNWCourse/ (fun to read lecture material)
• Analog Implementation Of Pulse-coupled Neural Networks...B.Wilamowski, http://www.eng.auburn.edu/~wilambm/pap/1999/TNN_Pulse2.pdf
• VLSI Implementation of Neural Networks B.Wilamowski, http://www.eng.auburn.edu/~wilambm/pap/2001/VLSIimpl.pdf
• Multilevel Logic Multiplier Using VLSI Neural Network, Pan, Manic, Li, Wilamowski, http://husky.engboi.uidaho.edu/pubs/ICIT%2703,%20Multilevel%20NN%20Multiplier,%20RP3_26.pdf

up

9. Software Implementations of ANN & FL

• Numenta Platform for Intelligent Computing (NuPIC).
  • implements hierarchical temporal memory system (HTM) patterned after the human neocortex, for problems that involve identifying patterns in complex data. The ultimate applications likely will include vision systems, robotics, data mining and analysis, and failure analysis and prediction. http://www.numenta.com/
• Matlab
  • http://www.mathworks.com/
  • Toolboxes: http://www.mathworks.com/products/product_listing/index.html
  • Neural Network Toolbox™ http://www.mathworks.com/products/neuralnet/
  • Fuzzy Logic Toolbox™ http://www.mathworks.com/products/fuzzylogic/
• Java applets for NN training
• AI Junkie
  • interested links http://www.ai-junkie.com/links.html
  • http://www.ai-junkie.com/files/smart_sweepers.zip
• Franck Fleurey
  • Face detection using using neural networks in the C# http://franck.fleurey.free.fr/FaceDetection/index.htm
  • C# Neural network library http://franck.fleurey.free.fr/NeuralNetwork/index.htm
• Aydin Gurel, Feed Forward NNs - A Java Implementation V2.0, http://aydingurel.brinkster.net/neural/

up

10. Intelligent Control

• MobileRobots Inc. (prev. ActiveMedia Robotics) http://www.mobilerobots.com/

up

11. Neural Network Research Groups

Many academic research groups are doing research into neural networks. Here are links to a few of them:
• http://www.cns.caltech.edu/
• The University of Toronto Neural Networks Research Group
• Salk Institute Computational Neurobiology Lab
• Aston University Neural Computing Research Group
• http://www.cse.ogi.edu/Neural
• Universität Ulm, Abteilung Neuroinformatik http://www.informatik.uni-ulm.de/ni/
  • ULM ANN Homepage http://www.informatik.uni-ulm.de/ni/forschung/ann.html
  • RBF http://www.informatik.uni-ulm.de/ni/forschung/forschungsthemen/rbf.html
• Slovak Center for Intelligent Technologies http://www.ai-cit.sk/
  • Neural Computing Surveys http://www.ai-cit.sk/
  • Kohonen, Recurrent, Grossberg's, RBF architectures http://neuron-ai.tuke.sk/NCS/VOL1/P3_html/node37.html
• Samuel Kaski's RG at Helsinki University exploratory data analysis and SOM.

up

12. Independent Component Analysis

Recently, there has been increasing interest in the neural network community in blind source separation (BSS), also called independent component analysis (ICA). Here are a few links to pages about ICA:

• Tony Bell's ICA Page
• Paris Smaragdis' ICA Page
  up

13. Support & Relevance Vector Machines

These related supervised learning methods used for classification and regression, beloning to a family of generalized linear classifiers. Here are a few links to pages about SVMs & RVMs:

• Professor Vladimir Vapnik - clrc Computer Learning Research Centre
• Descriptions
  • Support vector machine - Wikipedia
  • Kernel PCA
  • Relevance Vector Machine - Wikipedia
• Papers
  • Vladimir Vapnik and A. Lerner. Pattern recognition using generalized portrait method. Automation and Remote Control, 24, 1963.
  • Vapnik's paper on Support-vector networks from 1995 SpringerLink
• Books
  • Vojislav KECMAN's book Support Vector Machines, Neural Networks and Fuzzy Logic Models
  • N. Cristianini's and J. Shawe-Taylor's book An Introduction To Support Vector Machines
  • Panu Erasto's dissertation, Support Vector Machines - Backgrounds and Practice, Rolf Nevanlinna Institute, Helsinki 2001
• Software
  • Anton Schwaighofer Software (SVM Matlab Toolbox)
  • Freedownloadsoft http://www.freedownloadsoft.com/info/support-vector-machine.html
  • SVM - Support Vector Machines
  up

  14. Reinforcement Learning

  • Reinforcement Learning: An Introduction Sutton and Barto's book online
  • Reinforcement Learning Example

  ---

  This page was written by John Platt in the CCSP Group of Microsoft Research & last updated: 5/3/99. Later on updated by Milos Manic...
  

  ---