GPI Seminar Series: Guillem Palou

Guillem Palou, Detection-Classification Framework for Depth Ordering Evaluation
Wednesday May 22th, at 12:00, Seminar Room D5-007

Abstract:
In classification problems it is normal to present results using confusion matrices, where the missclassification of objects is observed among different classes. In detection frameworks, there normally exists a tradeoff between precision and recall. Moreover, if detected results are also supposed to be classified into different classes, it is likely that the classification score also depends on the precision-recall operating point of the system. For instance, if only confident detections are considered (low recall, high precision) it is likely to obtain a high classification score. On the contrary, if many results are retrieved, (low precision, high recall) it is also likely a decrease in classification performance. To integrate both the detection and classification problem, we introduce the concept of a precision-recall-classification framework to evaluate the performance of a system. We apply the proposed measures to the evaluation of state of the art depth ordering systems and show a clearer view on systems performance.