Usefulness
Here is a method that purports to tell ahead of time whether a given set of training data is going to be useful. You must read quite a bit before you get to that.
http://www.sandia.gov/imrl/XVisionScience/Xveri.htm