PsyPhy: A Psychophysics Driven Evaluation Framework for Visual Recognition

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. 41; no. 9; pp. 2280 - 2286
• Main Authors: RichardWebster, Brandon, Anthony, Samuel E., Scheirer, Walter J.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.09.2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Artificial neural networks; Computational modeling; Computer vision; deep learning; evaluation; Human performance; Machine learning; neuroscience; Object recognition; Observers; Protocol (computers); Psychology; Psychophysics; Recognition; Statistical tests; Task analysis; Visual perception; visual psychophysics; Visualization

By providing substantial amounts of data and standardized evaluation protocols, datasets in computer vision have helped fuel advances across all areas of visual recognition. But even in light of breakthrough results on recent benchmarks, it is still fair to ask if our recognition algorithms are doin...