ANOTHER GENERIC PATTERN RECOGNITION SITE IS THIS:

http://www.aic.nrl.navy.mil/~aha/research/machine-learning.html

 

 As of June, 2002, it looked like this:

 

 

 

Pattern Recognition on the Web

"To understand is to perceive patterns" - Isaiah Berlin

Go to Specific Links for 308-644 (Pattern Recognition course)

General Links:
Pattern Recognition:

  1. Introduction to Pattern Recognition
  2. Pattern Recognition Course on the Web (by Richard O. Duda)
  3. Introduction to Machine Learning (by Nils J. Nilsson)
  4. Image Processing Course
  5. Classification Society of North America
  6. Pattern Recognition Information
  7. Pattern Recognition Journals
  8. Machine Learning Resources
  9. Morphing Bibliography of Mark Grundland
  10. Neural Network Information
  11. Neural Network FAQ's
  12. Applets for Neural Networks
  13. Face Recognition Home Page
  14. Handwriting Recognition
  15. Java Demos for Handwriting Recognition
  16. Multivariate Analysis
  17. Iris Data
  18. Software and Hardware for Pattern Recognition Research
  19. Typography
  20. Music Meter Recognition (PS file)

Statistics:

Computer Vision and Graphics:

Information Theory:

  1. Information Theory links
  2. Information Theory Home Page
  3. Lectures on Information Theory, Pattern Recognition and Neural Networks
  4. Introduction to Information Theory
  5. Entropy

Computational Linguistics:

  1. Computational Linguistics Page
  2. Survey of Human Language Technology

Specific Chapter Links:

1. Introduction to Pattern Recognition via Character Recognition

  1. Notes on Methods of Proof
  2. Introduction to pattern recognition (PostScript)
  3. Digital images
    1. Scan Converting Polygons (Java demo)
    2. Alternatives to pixels
  4. Image Processing Basic Operators
  5. Optical character recognition (brief introduction)
    1. Magnetic Ink Character Recognition Fonts
    2. Bank Check Recognition System with E-13B Font (PostScript - 70 pages)
  6. Handwritten address recognition demonstration
  7. Tessellation Resources
  8. Tessellation Tutorials
  9. Grids:
    1. Grids, connectivity and contour tracing (PostScript)
    2. Contour tracing by radial sweep
    3. Contour Representations
    4. Shapes of unit area in a square unit grid
    5. Contour Tracing Algorithms: Tutorial by Abeer Ghuneim
  10. Digital lines and circles:
    1. A tutorial on the midpoint algorithm
    2. Interactive Java applet of the midpoint algorithm
  11. M.I.T. reading machine for the blind
  12. What is hysteresis?
  13. Zacharia Nkgau's tutorial on hysteresis smoothing of monotonic polygons (with interactive Java applet)
  14. Artistic Image Processing:
    1. Mark Grundland's Fractals from Voronoi Diagrams
  15. Image Segmentation:
    1. Image segmentation tutorial

2. Smoothing, Approximation, Data-Compression and Fitting

  1. Minkowski addition and subtraction (dilation and erosion)
    1. Interactive Java applet
  2. Regularization
  3. Logical smoothing
  4. Local averaging
  5. Median filtering:
    1. Median filtering introduction
    2. Median filtering and salt-and-pepper noise
    3. Adaptive weighted median filtering
  6. Gaussian smoothing
  7. More about Carl Friedrich Gauss
  8. Polygonal Approximation:
    1. Midpoint smoothing
      1. Tutorial and Interactive Java applet by Ziad Hafed and Diana Hernandez
    2. Ramer-Douglas-Peucker algorithm (Iterative End-Points Fit):
      1. Guirlyn Olivar's interactive Java applet
      2.  David Douglas tutorial on the Ramer-Douglas-Peucker algorithm
      3. Speeding up the Ramer-Douglas-Peucker algorithm with computational geometry
      4. More about David Douglas
    3. Interactive Java applets by Steve Robbins
    4. Relative Convex Hull Smoothing:
      1. Steve Robbins' Tutorial on Relative Convex Hulls
      2. Relative Convex Hull applet
      3. Computing the Relative Convex Hull and other geodesic properties in a polygon (PostScript)
    5. Graph-theoretic methods:
      1. Shuichi's Applet for Iri-Imai algorithm
    6. Smoothing by Curvature Flow(Java applet)
  9. Smoothing basics (PostScript)
  10. Tutorial on polygonal approximation (Iri-Imai algorithm, Melkman-O'Rourke algorithm)
  11. Curve Approximation Java Applet
  12. Line Fitting:
    1. Least-Squares Linear Fit Java Calculator
    2. Data Fitting Between Data Ranges
  13. Smoothing with splines:
    1. Cubic Spline Interactive Java applet
  14. Function Approximation:
    1. Interactive Java applet

3. Differentiation, Sharpening, Enhancement, Caricatures and Shape Morphing

  1. Differentiation and Edge Detection:
    1. Edge detection and the Sobel operator
    2. More on the Sobel oparator
    3. More edge detection
    4. Edge detection tutorial (Wolfram Research)
    5. Roberts cross operator
      1. More on the Roberts operator
  2. Enhancement and Lateral Inhibition:
    1. Sharpening, the Laplacian and lateral inhibition in neural networks (PostScript)
    2. Eye and retina
    3. Mach bands and lateral inhibition
    4. The retina and lateral inhibition
    5. The Lateral Inhibition Simulator (interactive Java applet)
    6. Another Lateral Inhibition Java demo
    7. Limulus-the horseshoe crab
  3. The Laplacian:
    1. The Laplacian in edge detection
    2. Laplacian edge detector applet
  4. Caricature Generation:
    1. Ian Garton's tutorial and interactive Java applet
  5. Fundamentals of Visual Perception:
    1. The Joy of Visual Perception
  6. Shape Morphing:
    1. Mark Grundland's morphing bibliography
    2. More morphing references

4. Measurement of Shape

  1. Affine transformations
  2. Affine Geometry
  3. More on affine transformations
  4. Moment Invariants
  5. Moments in Pattern Recognition (PostScript)
    1. Moments of area & perimeter
    2. Moments for feature extraction
    3. Moments for pre-processing
    4. Moments as predictors of discrimination performance
  6. Adam Ramadan's tutorial on moments in pattern recognition
  7. Computing Higher Moments of Polygons (Post Script)
  8. Affine and Other Geometric Transformations
  9. Fourier Descriptors:
    1. Recosntruction of closed curves from Fourier descriptors (Java applet)
    2. Fourier synthesis (Java applet)
  10. Other Measures of Shape:
    1. A Mathematical Theory of Layout Aesthetics

5. Skeletons, Distance and Medial Axis Transforms

  1. What is Distance?
    1. Manhattan Metric (Taxicab Geometry)
    2. Pascal Tesson's tutorial on taxicab geometry (with Java applet)
  2. Minkowski metrics
    1. More about Hermann Minkowski
  3. Distance between sets:
    1. Distance between strings
    2. The Maximum Distance
    3. The Minimum Distance
    4. The Hausdorff Distance
    5. Normand Gregoire & Mikael Bouillot's Tutorial on the Hausdorff distance and its applications (with interactive Java applet)
    6. The Grenander Distance
    7. Dynamic programming algorithm for edit-distance between strings
    8. Discrete Fourier Transforms made very easy!
  4. Skeletons (PostScript)
    1. Hilditch's algorithm
      1. Danielle Azar's tutorial
    2. Rosenfeld's algorithm
      1. Laleh Tajrobehkar's tutorial
      2. More about Azriel Rosenfeld
    3. Skeletonization software
  5. Medial Axis of Polygonal Sets (prairie-fire transformation)
    1. Morphological Shape Analysis via Medial Axis
    2. Medial Axis tutorial by Hang Fai Lau (with interactive Java applet)
    3. Martin Held's Fire Propagation Algorithm
  6. Distance transforms
  7. Skeleton clean-up via distance transforms
  8. Medial axes via distance transforms
  9. Medial axis transform
  10. Medial axis in 3D with applications
  11. Medial axis software
  12. Medial Axis of Pont Sets (also known as Nearest Point Voronoi Diagrams )
    1. Voronoi diagram applet of points in the plane
    2. Voronoi diagram applet of points on the sphere
  13. Medial Axis in 3D and the Power Crust

6. Shape Decomposition, Geometric and Topological Features

  1. Polygon Decomposition:
    1. Star-shaped decompositions (compressed PostScript: star.ps.gz)
  2. Convex hulls, concavities and enclosures:
    1. Interactive Java convex hull algorithms in 2D
    2. Clarkson's code for 2D convex hulls
  3. Geometric Feature Extraction Methods

7. Processing Line Drawings

  1. Basics of Freeman Chain Coding (PostScript)
    1. More about Herbert Freeman
    2. Square, circular, and grid-intersect quantization
    3. Probability of obtaining diagonal elements
    4. Geometric Probability
    5. Bertrand's paradox.
    6. More on Bertrand's paradox (with Java applet simulations)
    7. More about Joseph Bertrand
    8. Difference encoding & chain correlation functions
    9. Minkowski metric quantization
  2. Example of character recognition using chain codes

8. Detection of Structure in Noisy Pictures and Dot Patterns

  1. What is a line?
  2. Point-to-curve transformations (Hough transform)
  3. Point-Line duality
    1. Interactive Java Demo
  4. Hough Transforms:
    1. Hough Transform tutorial
    2. Improving the Hough Transform (paper by M. Cohen and G. Toussaint)
      1. Line and circle detection
      2. Hypothesis testing approach
      3. Maximum-entropy quantization
    3. Hough Transform home page (and software)
    4. Hough Transform publications
    5. More Hough Transform code
    6. Interactive histogram with Java applet
    7. Another nice tutorial on the Hough transform
  5. GraphTheory:
    1. Graphs
    2. Graph theory terminology
    3. Basic Graph Theory
  6. Proximity graphs:
    1. A Survey of Proximity Graphs
    2. Minimal spanning tree (MST) of a dot pattern
    3. MST interactive Java applet
    4. Delaunay Triangulations and Voronoi diagrams
    5. More about Boris Delaunay
  7. The shape of a set of points:
    1. The relative neighbourhood graph of a finite planar set
    2. Sphere-of-influence graphs and applet
    3. Alpha shapes
      1. François Bélair's Tutorial on Alpha Shapes (with interactive Java applet and a super-duper automated guided-tour demo)
      2. Introduction to alpha shapes
      3. Gallery of alpha shapes
      4. Code for computing alpha-shapes (and convex hulls)
    4. Beta skeletons:
      1. Xiaoming Zhong's Tutorial on Beta Skeletons (with interactive Java applet)
    5. Voronoi Diagram Based Methods:
      1. The Crust of  set of points

9. Simple Classifiers and Neural Networks

  1. Simple Classifiers
    1. Template matching
    2. Minimum-distance classifiers
      1. Minkowski metric classifiers
    3. Inner products
    4. Linear discriminant functions
    5. Decision boundaries
  2. Mahalanobis Distance Classifiers
  3. Learning from Examples
  4. Neural Networks:
    1. A Brief Tour of the Brain
    2. Introduction to Neural Networks
    3. Another Introduction to Neural Networks
    4. Dr. Gurney's course on neural networks
      1. Real and artificial neurons
      2. Threshold logic units, perceptrons and simple learning rules
    5. A brief history of Neural Networks
    6. Neural Network Basics (FAQ's)
    7. Formal neurons, linear machines & perceptrons
    8. Separability:
      1. Linear separability
      2. Separating points with circles
    9. Pierre Lang's Neural Network for Character Recognition (with interactive Java applet that recognizes the characters you draw on the screen!)

10. Bayesian decision Theory

  1. Bayesian Decision Theory with Gaussian Distributions - A tutorial by Erin Mcleish
  2. Introductory Statistics Course
  3. Another Introduction to Probability and Statistics
    1. Bayes' Theorem
    2. More about Thomas Bayes
    3. A Bayesian Puzzle
    4. The three-door puzzle (Monty Hall problem)
  4. Basics of Statistical Pattern Recognition (by Richard O. Duda)
  5. More about Richard Duda
  6. Minimum risk classification
  7. Minimum error classification
  8. Discriminant functions (linear, quadratic, polynomial)
    1. Quadric surfaces
    2. Geometry formulas and facts
    3. Discriminant analysis code in MATLAB
  9. The bivariate Gaussian probability density function
  10. Multivariate statistics
  11. Lecture Notes on Statistical Pattern Recognition
  12. Occam's Razor:
    1. Jacob Eliosoff's Tutorial on Occam's Razor in Decision Rules (with JAVA applet)
    2. Occam's Razor
    3. Occam's Razor and Machine Learning
    4. Simplicity, Cross-Validation and Occam's Razor
    5. More about William of Occam

11. Feature Selection: Independence of Measurements, Redundancy, and Synergism

  1. Independent and conditionally independent events
  2. Class-conditional and unconditional independence assumptions in pattern recognition (Tutorial by Simon-Pierre Desrosiers)
  3. Independence, uncorrelation and Gaussian distributions (PostScript notes by Julio Peixoto)
  4. Information theory:
    1. A primer on information theory (PostScipt)
    2. Basic properties of Shannon's entropy and mutual information
    3. Relative entropy and mutual information
    4. From Euclid to entropy (PostScript)
    5. Shannon's equivocation and the Fano bound
    6. More about Claude Shannon
    7. The Claude Shannon Home Page
    8. Calculating Information and Complexity
  5. Feature Selection:
    1. Independence, Redundancy and Synergism: A Tutorial by Irina Kezele
    2. Feature Selection: Evaluation, Application, and Small Sample Performance (PostScipt)
    3. Toward Optimal Feature Selection (PostScipt)
    4. Dimensiobality Reduction: Francois Labelle's tutorial (with interactive Java applets)
    5. Simon Plain's tutorial on feature selection (with interactive Java applets)
    6. Feature evaluation criteria:
      1. Kullback-Liebler information
      2. The Divergence
      3. The Affinity
      4. The Mutual-Information criterion (PDF file)
      5. Discrimination information and Kolmogorov variational distance (PDF file)
      6. The Fisher Information
        1. More about Sir Ronald Fisher
        2. Pictures of Fisher
    7. Feature selection methods (Richard Duda's course notes)
    8. A survey of feature selection methods
    9. The best K independent measurements are not the K best (PDF file)
    10. Models of spatial dependence between features
      1. Space-filling curves (Hilbert and Peano)
      2. Sierpinski curves

12. Non-parametric Learning

  1. General Learning Resources
  2. Perceptrons:
    1. Simple perceptrons and the exclusive OR problem
    2. Applet for Perceptron learning in the exclusive OR problem
  3. Non-parametric training of linear machines (Nilsson's book - Chapter 4)
  4. Error-correction procedures
    1. Rosenblatt's Perceptron Learning Algorithm (an interactive Java applet)
  5. The fundamental learning theorem
  6. Multi-layer networks
  7. Competitive Learning:
    1. Applet illustrating many competitive learning algorithms

13. Estimation of Density Functions, Parameters and Classifier Performance

  1. Estimation of Parameters:
    1. Robust estimators of location (Tutorial by Greg Aloupis)
    2. Bias and variance of estimators
    3. Maximum likelihood estimation
  2. Density Estimation:
    1. Kernel density estimation applet
  3. Estimators and Bias (Wolfram Research)
  4. Dimensionality and sample size
  5. Estimation of the probability of misclassification
  6. Estimation of misclassification before 1974
    1. Resubstitution
    2. Holdout
    3. Data Shuffling
    4. Leave-One-Out
    5. Bootstrap Methods
  7. Ensembles of Classifiers
  8. Boosting

14. Nearest Neighbor Decision Rules

  1. Nearest Neighbor Decision Rules:
    1. The nearest neighbor rule: a tutorial
    2. The nearest neighbor rule with a reject option
    3. The k-nearest neighbor rule applet
    4. The Cover-Hart bounds and Jensen's inequality:
      1. Jensen's inequality
      2. Convexity and Jensen's inequality (proof by induction)
      3. A Visual Explanation of Jensen's Inequality
      4. Convexity and Jensen's Inequality
      5. A Simple Proof of the Jensen-Steffensen Inequality
      6. More about Johan Ludwig William Valdemar Jensen
      7. More about Thomas Cover
      8. More about Peter Hart
  2. Efficient search methods for nearest neighbors:
    1. The projection method for searching nearest neighbors (algorithm of Friedman, Baskett and Shustek)
      1. More about Jerome Friedman
    2. Nearest neighbor searching papers
    3. Approximate nearest neighbor searching
  3. Editing nearest neighbor rules to reduce storage:
    1. Reducing the size of training sets with proximity graphs (PostScript)
    2. Sergei Savchenko's tutorial on nearest neighbor condensing rules
    3. Chris Cocosco's tutorial on nearest neighbor editing rules for smoothing decision rules
    4. Nearest neighbor editing and condensing tools (PostScript)
  4. Nearest neighbor computation software
  5. Bibliography on Nearest Neighbor Methods

15. Using Contextual Information in Pattern Recognition

  1. Using Context in Visual Perception
  2. Infinite Monkey Theorem
  3. Introduction to Markov Processes
  4. More about Andrei Markov
  5. Forward dynamic programming and the Viterbi algorithm:
    1. A tutorial on the Viterbi algorithm
    2. Viterbi algorithm demo for sentence recognition
  6. Combined bottom-up and top-down algorithms

16. Unsupervised Learning & Cluster Analysis

  1. Unsupervised Learning:
    1. Decision-directed learning (the K-means algorithms)
    2. K-Means Interactive Java Applet by Laurent Bonnefille and Nicolas Didier.
  2. Graph-theoretic methods:
    1. Minimal spanning tree methods
    2. Tutorial and Java applet by Mike Soss and Chrislain Razafimahefa
  3. Hierarchical clustering:
    1. Pascal Poupart's tutorial with interactive Java applet
    2. Phylogenetic Trees (A Tutorial)
    3. Clustering software on the Web
    4. Cluster Analysis: What is it? (Fantastic tutorial!)
    5. Clustering Calculator

17. Support Vector Classifiers

    1. Support Vector Classifiers: A First Look
    2. Tutorial on Support Vector Machines and Vapnik-Chervonenkis (VC) Dimension for Pattern Recognition (PostScript)
    3. Support Vector Applet and References

Teaching Activities Homepage