Skip to Main content Skip to Navigation
New interface

Segmentation interactive multiclasse d'images par classification de superpixels et optimisation dans un graphe de facteurs

Bérengère Mathieu 1 
1 IRIT-TCI - Traitement et Compréhension d’Images
IRIT - Institut de recherche en informatique de Toulouse
Abstract : Image segmentation is one of the main research topics in image analysis. It is the task of researching a partition into regions, i.e., into sets of connected pixels, meeting a given uniformity criterion. The goal of image segmentation is to find regions corresponding to the objects or the object parts appearing in the image. The choice of what objects are relevant depends on the application context. Manually locating these objects is a tedious but quite simple task. Designing an automatic algorithm able to achieve the same result is, on the contrary, a difficult problem. Interactive segmentation methods are semi-automatic approaches where a user guide the search of a specific segmentation of an image by giving some indications. There are two kinds of methods : boundary-based and region-based interactive segmentation methods. Boundary-based methods extract a single object corresponding to a unique region without any holes. The user guides the method by selecting some boundary points of the object. The algorithm search for a curve linking all the points given by the user, following the boundary of the object and having some intrinsic properties (regular curves are encouraged). Region-based methods group the pixels of an image into sets, by maximizing the similarity of pixels inside each set and the dissimilarity between pixels belonging to different sets. Each set can be composed of one or several connected components and can contain holes. The user guides the method by drawing colored strokes, giving, for each set, some pixels belonging to it. If the majority of region-based methods extract a single object from the background, some algorithms, proposed during the last decade, are able to solve multi-class interactive segmentation problems, i.e., to extract more than two sets of pixels. The main contribution of this work is the design of a new multi-class interactive segmentation method. This algorithm is based on the minimization of a cost function that can be represented by a factor graph. It integrates a supervised learning classification method checking that the produced segmentation is consistent with the indications given by the user, a new regularization term, and a preprocessing step grouping pixels into small homogeneous regions called superpixels. The use of an over-segmentation method to produce these superpixels is a key step in the proposed interactive segmentation method : it significantly reduces the computational complexity and handles the segmentation of images containing several millions of pixels, by keeping the execution time small enough to ensure comfortable use of the method. The second contribution of our work is an evaluation of over-segmentation algorithms. We provide a new dataset, with images of different sizes with a majority of big images. This review has also allowed us to design a new over-segmentation algorithm and to evaluate it.
Document type :
Complete list of metadata

Cited literature [83 references]  Display  Hide  Download
Contributor : ABES STAR :  Contact
Submitted on : Monday, December 10, 2018 - 11:32:07 AM
Last modification on : Wednesday, September 21, 2022 - 3:52:16 AM
Long-term archiving on: : Monday, March 11, 2019 - 1:59:12 PM


Version validated by the jury (STAR)


  • HAL Id : tel-01949597, version 1


Bérengère Mathieu. Segmentation interactive multiclasse d'images par classification de superpixels et optimisation dans un graphe de facteurs. Traitement des images [eess.IV]. Université Paul Sabatier - Toulouse III, 2017. Français. ⟨NNT : 2017TOU30290⟩. ⟨tel-01949597⟩



Record views


Files downloads