Week 01 (01.12.2006)
ref. mat. session 01 & 02
|
Introduction - class description
history
McCulloch-Pitts neurons |
Week 02 (01.19.2006)
ref. mat. session 03 & 04
|
Single neuron operation
selecting rectangular area
selecting arbitrary 2-dimensional area
Supervised vs. unsupervised learning |
Week 03 (01.26.2006)
ref. mat. session 05 & 06
|
Hamming distance
single neuron operation (Hebbian & Perceptron rule)
perceptron learning rule (hard vs. soft activation function) |
Week 04 (02.02.2006)
ref. mat. session 07 & 08 |
LMS
Delta learning rule
derivation of bipolar soft activation function
Analytic geometry in Euclidean space (review)
Minimum distance classifiers
Winner Take All
calculating distance in Euclidean space
Sarajedini and Hecht-Nielsen network
perceptron adjustable rule |
Week 05 (02.09.2006)
ref. mat. session 09 & 10
|
More on derivation of bipolar soft activation
perceptron adjustable rule
pseudo inversion training
error back propagation |
Week 06 (02.16.2006)
ref. mat. session 11 & 12
|
Error Back Propagation (EBP) algorithm, example
Heuristic approaches to modifications of EBP (variable gain, learning constant, weight rescaling, momentum, search along the gradient) |
Week 07 (02.23.2006)
ref. mat. session 13 & 14 |
Heuristic approaches to EBP modifications (Quickprop, RPROP, Back Percolation, Delta-Bar-Delta)
Soft Activation Function (first derivative and gain, Flat spot problem)
XOR Problem; NNOTT tool |
Week 08 (03.02.2006)
ref. mat. session 15 & 16
|
Exam#1 review |
Week 09 (03.09.2006)
ref. mat. Ex#1 & sess. 17
|
Exam#1
Steepest descent method
Newton method
Levenberg-Marquardt Algorithm (LM)
Modifications of LM Algorithm
Steepest descent method
Feedback networks
Intro on Hopfield networks |
Week (03.16.2006)
|
Spring Break |
Week 10 (03.23.2006)
ref. mat. session 18 & 19
|
Post exam#1 review (separate recording)
Feedback networks
Hopfield networks
Retrieval order (steepest descent, synchr/asynchr update)
Associative memories |
Week 11 (03.30.2006)
ref. mat. session 20 & 21
|
Associative Memories
MAM - Multidirectional Associative Memories
Memory capacity and corruption
Dynamic feedback networks, applications
Kohonen WTA network (steps, example) |
Week 12 (04.06.2006)
ref. mat. session 22 & 23
|
Kohonen WTA network (problems and possible solutions)
Adaptive Resonance Theory
Mountain Clustering
Forming clusters as needed
Functional link network
Polynomial networks
Counter Propagation Networks (CPN)
Analog memories |
Week 13 (04.13.2006)
ref. mat. session 24 & 25
|
Exam#2 review
Radial Basis Function Networks
Competitive Networks ( Learning Vector Quantization, Matching & Self-Organizing Networks, MAXNET, Hamming Network)
Cascade Correlation networks |
Week 14 (04.20.2006)
ref. mat. Ex#2 & sess. 26 |
Exam#2
Fuzzy systems, fuzzy sets
Fuzzy measure and distances
Fuzzy Entropy, Subsethood
Minimum, product, correlation encoding
Fuzzy Associative Memories (FAM) |
Week 15 (04.27.2006)
ref. mat. session 27 & 28 |
Post Exam#2 review (separate recording) Fuzzy Controllers Zadeh and Sugeno fuzzy controllers Zadeh fuzzy controllers Design example of Zadeh fuzzy controller Design example of Sugeno fuzzy controller
Comparison of Zadeh and Sugeno FC
Comparison of Neural and Fuzzy systems
Pulse Coupled Neural Networks (PCNN) |
Week 16 (05.04.2006)
ref. mat. session 29 & 30 |
Final exam review No-examination week Project paper presentations VLSI implementation of ANNS
Refinement of fuzzy operators
Fuzzy Decision Support Systems
Fuzzy preference relation
Evolutionary Computation (GA)
|
| Week 17 (05.08-12.2006) |
Exam #3
Final examinations |
| 05.12.2006 |
Close of Spring semester |
| |
|