Evaluation Metric

The quantitative performance of individual cell cytoplasm segmentation (on the synthetic dataset) is assessed using the average Dice Coefficient, measured as

$DC = frac{2|A cap B|}{|A| + |B|}$

over the ‘‘good“ cell segmentations [1], where a ‘‘good” segmentation is considered to be one with a DC>0.7. We also measure the object-based false negative rate (FNo) obtained as the proportion of cells having a DC <= 0.7. In addition, we show a pixel-based evaluation using the true positive rate (TPp) and false positive rate (FPp) for both training and test sets using the ‘‘good" cell segmentations.

References

Radau, P., Lu, Y., Connelly, K., Paul, G., Dick, A., Wright, G. Evaluation framework for algorithms segmenting short axis cardiac MRI. The MIDAS Journal - Cardiac MR Left Ventricle Segmentation Challenge (2009)