A Validation Tool For Improving Semantic Segmentation of Complex Natural Structures

Eurographics 2019 - Short papers, page 57--60 - May 2019
Download the publication : EG2019-tool.pdf [2.1Mo]  

The automatic recognition of natural structures is a challenging task in the supervised learning field. Complex morphologies are difficult to detect both from the networks, that may suffer from generalization issues, and from human operators, affecting the consistency of training datasets. The task of manual annotating biological structures is not comparable to a generic task of detecting an object (a car, a cat, or a flower) within an image. Biological structures are more similar to textures, and specimen borders exhibit intricate shapes. In this specific context, manual labelling is very sensitive to human error. The interactive validation of the predictions is a valuable resource to improve the network performance and address the inaccuracy caused by the lack of annotation consistency of human operators reported in literature. The proposed tool, inspired by the Yes/No Answer paradigm, integrates the semantic segmentation results coming from a CNN with the previous human labeling, allowing a more accurate annotation of thousands of instances in a short time. At the end of the validation, it is possible to obtain corrected statistics or export the integrated dataset and re-train the network.

Images and movies

 

BibTex references

@InProceedings\{PCPS19,
  author       = "Pavoni, Gaia and Corsini, Massimiliano and Palma, Marco and Scopigno, Roberto",
  title        = "A Validation Tool For Improving Semantic Segmentation of Complex Natural Structures",
  booktitle    = "Eurographics 2019 - Short papers",
  pages        = "57--60",
  month        = "May",
  year         = "2019",
  editor       = "Cignoni, P. ; Miguel, E.",
  publisher    = "Eurographics Association",
  keywords     = "Human-center Computing; Graphical User Interfaces; Visual Analytics; Image Segmentation",
  url          = "http://vcg.isti.cnr.it/Publications/2019/PCPS19"
}

Other publications in the database

» Gaia Pavoni
» Massimiliano Corsini
» Marco Palma
» Roberto Scopigno