Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Morphological segmentation of hyperspectral images

Morphological segmentation of hyperspectral images Submitted to Image Anal Stereol, 9 pages Original Research Paper GUILLAUME NOYEL, JESÚS ANGULO AND DOMINIQUE JEULIN Centre de Morphologie Mathématique, Ecole des Mines de Paris, 35 rue Saint-Honoré, Fontainebleau, F–77305, France e-mail: {guillaume.noyel, jesus.angulo, dominique.jeulin}@ensmp.fr (Submitted) ABSTRACT The present paper develops a general methodology for the morphological segmentation of hyperspectral images, i.e. with an important number of channels. This approach, based on watershed, is composed of a spectral classification to obtain the markers and a vectorial gradient which gives the spatial information. Several alternative gradients are adapted to the different hyperspectral functions. Data reduction is performed either by Factor Analysis or by model fitting. Image segmentation is done on different spaces: factor space, parameters space, etc. On all these spaces the spatial/spectral segmentation approach is applied, leading to relevant results on the image. Keywords: factor analysis, hyperspectral imagery, mathematical morphology, watershed segmentation. INTRODUCTION Watershed segmentation requires a gradient (i.e. a scalar function) and markers on the target structures to obtain a correct image segmentation Hyperspectral images are multivariate discrete (Beucher and Meyer, 1993). A gradient on a functions with typically several tens or hundreds multivariate function can be obtained in different of spectral bands. In a formal way, each pixel of ways. One way is to calculate on each image channel an hyperspectral image is a vector with values in a modulus of a gradient, and to take the sum wavelength, in time, or associated with any index j. To or the supremum of the gradients (Meyer, 1992; each wavelength, time or index corresponds an image Angulo and Serra, 2003). Another way is to use in two dimensions called channel. In the sequel we vectorial gradients based on distance between vector use only the term of spectrum and spectral channel. pixels (Angulo and Serra, 2003; Evans and Liu, 2006). The number of channels depends on the nature of We consider here various alternatives for hyperspectral the specific problem under study (satellite imaging, images. spectroscopic images, temporal series, etc.). Let Moreover, when dealing with hyperspectral E → T images, the large number of channels generates data f : x → f (x) = f (x), f (x),..., f (x) redundancies. Consequently, it is necessary to reduce λ λ λ λ 1 2 L (1) the amount of data, to extract pertinent information. To be an hyperspectral image, where: do this, two ways are explored: a linear factor analysis and a model approach. 2 L •E ⊂ R , T ⊂ R and T = T ×T × ...×T Previously in the literature, several approaches •x = x \ i ∈ {1,2,... ,P} is the spatial coordinates of to multispectral image segmentation were explored. a vector pixel f (x ) (P is the pixels number of E) λ Flouzat et al. (1998) use a spatial and a spectral segmentation based on the filtering of the image • f \ j ∈ {1,2,... ,L} is a channel (L is the channels adjacency graph. Paclík et al. (2003) obtain, with number) statistical classifiers, the pixels probabilities of membership to clusters for spectral domain and • f (x ) is the value of vector pixel f (x ) on channel i i λ λ the pixels probabilities of membership to clusters f . for spatial domain. The pixels probabilities of In this paper, we introduce a general methodology membership to a cluster are obtained by multiplying for hyperspectral image segmentation, using both probabilities, because they assume independence a watershed based approach. The watershed between spatial and spectral information. The pixels transformation is a powerful tool for mathematical are classified and the process is repeated until morphology segmentation (Serra and Cressie, 1982; convergence. Li and Xiao (2004) compute on each Soille, 2003). channel a morphological multiscale gradient by arXiv:2010.00853v1 [eess.IV] 2 Oct 2020 NOYEL G et al.: Morphological segmentation of hyperspectral images summation of morphological gradients with increasing FRAMEWORK FOR MORPHO- size structuring elements. As watershed requires LOGICAL SEGMENTATION ON a scalar gradient (i.e. one channel), the channels MULTIVARIATE DATA gradients are summed with a weight equal to one. After morphological filtering on the gradient, the The watershed transformation is one of the most local minima are used as markers for watershed powerful tools for segmenting images. According to segmentation. Scheunders (2001) computes a gradient a flooding paradigm, the watershed lines associate a by summation of channels gradients followed by catchment basin to each minimum of the function a watershed segmentation. Soille (1996) combines (Beucher and Meyer, 1993). Typically, the function spectral classification on histograms and spatial to flood is a gradient function which defines the segmentation. The multidimensional histogram is transitions between the regions. Using the watershed segmented, using the watershed algorithm, to obtain on a scalar image without any preparation leads to a a classified image. On the classified image the minima strong over-segmentation (large number of minima). of the gradient of the hyperspectral image are imposed. There are two alternatives in order to get rid of the With the gradient and the markers he applies the over-segmentation. The first one consists in initially watershed segmentation. determining markers for each region of interest: using The methodology and the different alternatives the homotopy modification, the local minima of the studied in the current paper are illustrated by means of gradient function are only the region markers. A a 60 channels image acquired by active thermography difficult issue is to determine the markers, especially on plastic lids. The size of the image is 256 × 256 for generic images. The second alternative involves pixels × 60 channels. The aim is to segment glue hierarchical approaches based on non-parametric occlusions within plastic lids. This sequence of images merging of catchment basins (waterfall algorithm) comes from Laboratoire Le2i, Le Creusot, France. or based on the selection of the most significant Legrand et al. (2002) explain how the image was minima according to different criteria (dynamics, area acquired. They also present a segmentation that was or volume extinction values) (Meyer, 2001). done on a channel, using difference of lid images In this paper, we focus on markers based with and without glue, thresholding and filtering. Their segmentation. In fact, we consider that the segmentation is used as a reference for comparison hyperspectral images have enough information to (fig. 1). In our case, only the sequence with glue define markers from a spectral classification. occlusions is available. That’s why we cannot use image difference or any kind of calibration with a Multivariate gradients reference image. A gradient image, in fact the norm, is a scalar function with values in the reduced interval [0,1], i.e. ∇ : E → [0,1]. This normalization is always applied to multivariate gradients given below in order to have homogeneous gradient functions. To define a gradient, four approaches are considered: a morphological gradient on one channel, a metric-based gradient on all channels, a gradient defined as the supremum, or as the sum, of morphological gradients on each channel. The morphological gradient is a marginal gradient f f (i.e. it can only be applied on scalar images) defined λ λ 1 30 as the difference between the channel dilation and erosion with a structuring element B which is the neighborhood of point x ∈ E (Serra and Cressie, 1982): g( f (x)) = δ ( f (x))−ε ( f (x)) (2) λ B λ B λ x x j j j = ∨ ( f (x))−∧ ( f (x)) B λ B λ x x j j The gradient supremum of morphological f reference gradients on each channel is a vectorial gradient defined as: Fig. 1. Three channels of the original image and the reference obtained by Legrand et al. (2002) method. ∇ f (x) = ∨[g( f (x)), j ∈ {1,... ,L}] (3) ∨ λ λ 2 Image Anal Stereol ?? (Please use \volume):1-9 Each morphological gradient must be normalized Markers by spectral clustering between [0,1] before taking the supremum. The markers defining the targets are obtained with an unsupervised classification based on clustering. We The gradient weighted sum of morphological have used in this study the clustering algorithm "Clara" gradients is given by: (Kaufman and Rousseeuw, 1990). This is a similar way, but more robust than the "kmeans" classification, ∇ f (x) = w g( f (x)) (4) + λ ∑ λ λ j j in order to cluster large numbers of points. Then, the j=1 pertinent clusters are selected to be the markers. To perform clustering, each channel is considered as a where w denotes the weight of the gradient of variable. Therefore each pixel has its own value on channel f . each variable. The metric-based gradient is a vectorial gradient defined as the difference between the supremum and the infimum of a defined distance on a unit DATA REDUCTION AND FILTERING neighbourhood B(x): USING FACTOR ANALYSIS ∇ f (x) = ∨[d(f (x),f (y)),y ∈ B(x)]− λ λ λ Due to the redundancy of channels, a data ∧ [d(f (x),f (y)),y ∈ B(x)] λ λ reduction is performed using Factor Correspondence . (5) Analysis (FCA) (Benzécri, 1973). We prefer an FCA in place of a Principal Component Analysis because Various metric distances are available for this gradient image values are positive and the spectral channels such as: can be considered as probability distributions. The metric used in FCA is the chi-squared normalized by •Euclidean distance: channels weight. This metric is adapted to probability laws. FCA can be seen as a transformation from image t 2 space to factorial space (eq. 10). In factorial space d (f (x),f (y)) = ( f (x)− f (y)) (6) E λ λ ∑ λ λ j j the coordinates of the pixels vector on each factorial j=1 axis are called pixels factors. The pixels factors can be considered as an hyperspectral image whose channels •Mahalanobis distance: correspond to factorial axes: d (f (x),f (y)) = M L K λ λ T → T / K < L ζ : f f f t −1 f (x) → c (x) = c (x),...,c (x) (f (x)− f (y)) Σ (f (x)− f (y)) (7) λ α α α λ λ λ λ 1 (10) A limited number K of factorial axes is usually chosen. where Σ is the covariance matrix between variables Therefore FCA can be seen as a projection of initial (channels) of f . If channels are uncorrelated, pixels in a factor space with a smaller dimension. the covariance matrix is diagonal. The diagonal values are equal to channels variance σ \ j ∈ The pseudo-inverse transform consists in {1,2,... ,L}. Therefore, the Mahalanobis distance reconstructing the images from factors (eq. 11). This is an approximation of the original image if one keeps becomes: a part of factorial axes for the reconstruction: u L f (x)− f (y) K L λ λ j j T → T / K < L −1 d (f (x),f (y)) = b λ λ ∑ ζ : b b b c (x) → f (x) = f (x),... , f (x) j=1 j α λ λ λ 1 L (8) (11) Besides, hyperspectral images usually contain noise •chi-squared distance: due to the acquisition device, compression, etc. In this case it is possible to use FCA to filter images. As d (f (x ),f (x ′)) = λ i λ i shown by Green et al. (1988), the noise is rejected on u L f (x ) f (x ′) the last factorial axes whereas the signal remains on N λ i λ i j j − (9) ∑ the first axes. By keeping only axes with sufficient f f f .λ x . x . i ′ j=1 j signal and reconstructing the image, all channels are filtered. In our example, the image is very noisy ; P J with f = f (x ), f = f (x ) and ∑ ∑ i x . i .λ i=1 λ i j=1 λ j j j consequently better results are obtained by filtering L P N = f (x ). the whole sequence with a FCA, keeping the two ∑ ∑ λ i j=1 i=1 3 NOYEL G et al.: Morphological segmentation of hyperspectral images first factorial axes (fig. 2). The eigenvalues associated The Euclidean distance in FCA factorial space is −4 with these two factors are μ = 13.9 10 and μ = equivalent to the chi-squared distance in image space 1 2 −4 3.15 10 . In other words, the first axis represent (Benzécri, 1973). Therefore a chi-squared distance 13.8% of inertia and the second one 3.1%. Therefore, based gradient ∇ f (x) is performed on the filtered the inertia of the two first axes is equal to 16.9% image f (x) and an Euclidean distance based gradient which is small. In fact the next axes contain a lot of f f ∇ c (x) on the FCA factors c (x). Then the watershed α α noise. This explains why their share in inertia is high. segmentation is computed (fig. 4 and 5). Both Therefore, they must be removed to get information segmentations, compared to the reference model (fig. without noise. 1), are not satisfactory for the present image. f f λ λ 50 50 (a) (b) Fig. 2. f and f are the channel 50 before and after λ λ 50 50 filtering by FCA. SEGMENTATION OF f (x), c (x) It is possible to generate a segmentation on the (c) (d) hyperspectral image composed of factorial axes c (x) (fig. 3) or on the filtered image f (x). Fig. 4. Processes are computed on the filtered image f (x). (a) Clara segmentation, (b) Green cluster corresponding to glue used as markers, (c) Chi- squared gradient, (d) Watershed segmentation. For visualization, gradients are scaled by a factor. f f c (x) c (x) α α 1 2 Fig. 3. FCA factors on axes 1 and 2 of original image. For visualization, factors are scaled by a factor. In the factorial space made up of the two first axes, (a) (b) a classification by "Clara" is processed. Then the green cluster corresponding to glue is selected defining the markers (fig. 5). In order to regularize these markers, an opening with an hexagonal structuring element of size 5 is applied. As differences between glue and lid are small, a gaussian filter of size 11 followed by a morphological leveling are applied on each channel, to (c) (d) enhance the contours and to obtain a better gradient. The levelings are a subclass of symmetric connected filters (or filters by reconstruction) that suppress Fig. 5. Processes are computed on the factor details but preserve the contours of the remaining pixels c (x). (a) Clara segmentation, (b) Green objects (Meyer, 2004). The levelings need an image cluster corresponding to glue used as markers, (c) marker, a rough simplification of the reference image, Euclidean gradient, (d) Watershed segmentation. For to determine the structures to be leveled. visualization, gradients are scaled by a factor. 4 Image Anal Stereol ?? (Please use \volume):1-9 DATA REDUCTION USING MODEL by PCA (fig 7). In this case the different axes represent the following inertia ratios 97.24%, 2.10% APPROACH and 0.66%. Another way to reduce data is to fit a model on the spectrum of each pixels vector. The parameters of the model fitted in each pixel are seen as parametrical cartographies or maps. The whole maps generate an hyperspectral image p(x) = (p (x),... , p (x)). This 1 M approach is advantageous in the way it takes the order of channels into account. In fact, in FCA channels the order is without importance. p = a p = b p = m 1 2 3 Moreover, with the hyperspectral image of parameters, a segmentation can be computed. It is also possible to make parameters orthogonal with a Principal Component Analysis and then generating a segmentation. Principal Component Analysis (PCA) is used here p p p axis 1 c axis 2 c axis 3 c instead of FCA, because it is possible to compute β β β 1 2 3 it on hyperspectral images with negative values, which can be the case for some parameters. PCA Fig. 7. Maps of the parameters of the linear model, PCA factors of the parameters on axis 1, 2 and 3.. gives factorial axes with factors building another p p p hyperspectral image: c (x) = (c (x),... ,c (x)). β β β 1 M SEGMENTATION OF p(x) OR c (x) For this thermographic sequence, a linear model is fitted on the image after removing the 10 first channels Different approaches of segmentation are tested which correspond to a transitory phenomenon (fig. 6). on parameters p(x) or on parameters factors c (x). The linear model y = ax + b has two parameters, the Markers are computed again by the cluster method slope a and the intercept b. On the first 10 channels we "Clara" on the parameters and the image of factors . have defined another parameter, called rise m, as the First, a clustering is processed on both images. The maximum amplitude on these 10 channels: cluster corresponding to the lid center is selected because the glue is on the lid center. A second b b m(x) = max ( f (x))− min ( f (x))). (12) λ λ j j clustering "Clara" is made on the selected cluster. Non j∈[1:10] j∈[1:10] selected pixels are aggregated to the cluster of the largest size, because cluster corresponding to glue has the smallest size (fig. 8). (a) (b) (a) (b) (c) (d) Fig. 6. (a) Point outside glue where is measured (c) (d) spectrum (b), (c) point inside glue and corresponding spectrum (d). Fig. 8. (a) Clara segmentation in 4 clusters on Then with the linear model we obtain images as parameter b, blue cluster is selected, (b) Clara on maps of the parameters, which can be orthogonalised parameters a and m: parameters markers, (c) Clara 5 NOYEL G et al.: Morphological segmentation of hyperspectral images segmentation in 3 clusters on first axis c , green A metric-based gradient with the Mahalanobis p p distance ∇ p(x), and a gradient supremum of cluster is selected, (d) Clara on axes 2 and 3 (c , c ): β β 2 3 channels gradient ∇ p(x) are tested on the parameters parameters factors markers. image (fig. 10). In this case the gradient sum ∇ p(x) is To improve the quality of gradients, each image approximatively equivalent to the supremum gradient channel is again leveled using as image markers the because it is not possible to define specific weights for corresponding channels, filtered by a gaussian kernel. the parameters. For each case, the same markers are Then, several gradients are tested. The morphological used. Moreover, to compute the Mahalanobis distance, gradient on each channel g, the supremum and the sum we assume that parameters are uncorrelated. of morphological gradients, ∇ and ∇ , are evaluated ∨ + on the image of parameters p(x) and on the image of PCA factors parameters c (x). Besides the Euclidean distance in PCA factorial space is equivalent to the Mahalanobis distance in parameters space. Therefore, the Mahalanobis distance based gradient ∇ p(x) is performed on the parameters p(x) to ensure the equal statistical value for the different parameters. For the (a) (b) PCA factors parameters c (x), the most indicated is the Euclidean distance based gradient. Watershed on parameters The morphological gradient is computed on each channel of image p(x). Markers (fig. 8 (b)) are filtered (c) (d) by opening with an hexagonal structuring element of size 5. With the gradient and the markers, a watershed Fig. 10. Segmentations on parameters: (a) segmentation is obtained for each parameter. Mahalanobis distance based gradient, (b) associated watershed, (c) gradients supremum, (d) associated watershed. For visualization, gradients are scaled by a factor. Both segmentations from a vectorial gradient are good, compared to the reference. Consequently vectorial gradients are good in both cases. Watershed on PCA axes of parameters As for parameters, a morphological gradient is computed on each channel of c (x). The markers (fig. 8 (d)) are again regularized with an opening followed by the corresponding watershed of each gradient. The resulting segmentations on the parameters a b m p p factors on axes 1, c , and 2, c , are good, β β 1 2 as compared to the reference (fig. 11). In fact Fig. 9. First line: morphological gradient, second line: their gradients have distinct contours without leaks. watershed on parameters: slope a, intercept b and rise However, it is not the case for morphological gradient m. For visualization, gradients are scaled by a factor. on the parameters factors on axes 3, c . Moreover, as Comparing to the reference, segmentations with for parameters, vectorial gradients are also tested. morphological gradients on parameters slope a and rise p First of all, an Euclidean gradient ∇ c (x) is m are good. However, the segmentation on intercept tested. Then the supremum of channels gradient b is not satisfactory, due to the leaks on the gradient. p p ∇ c (x) and the weighted sum gradient ∇ c (x) are ∨ + β β Although these segmentations are pertinent, they are used (fig. 12). The weights for ∇ c (x) are equal to the only marginal segmentations, i.e. only one parameter + is taken into account in one segmentation. Therefore, inertia contributions of axes: 0.97, 0.021 and 0.0066. we have tested the use of a vectorial gradient. For each case the same markers are used. 6 Image Anal Stereol ?? (Please use \volume):1-9 of PCA parameters is not relevant (fig. 11). However, the weighted sum gradient is much better because the weight the third axis is very low compared to the other ones. In this case the weighted sum gradient is more adapted. Consequently, the Euclidean gradient and the supremum of morphological gradients are tested on the two first PCA parameters axes (fig. 13). In this case, the segmentations are much better. Therefore, the choice of axes for which the gradient is better must be emphasized. In fact, adding another noisy axis creates leaks on the gradient. axis 1 axis 2 axis 3 Fig. 11. Morphological gradient and watershed on p p factors of PCA parameters: axis 1 c , axis 2 c and β β 1 2 axis 3 c . For visualization, gradients are scaled by a factor. (a) (b) (c) (d) (a) (b) Fig. 13. Segmentations on PCA parameters factors on axes 1 and 2: (a) Euclidean gradient, (b) associated watershed, (c) gradient supremum, (d) associated watershed. For visualization, gradients are scaled. (c) (d) OVERVIEW OF METHODS -1 f −1 f ( x ) FCA ζ FCA λ ζ c ( x ) (e) (f) c ( x ) PCA f ( x ) ζ p( x ) Modeling Fig. 12. Segmentations on PCA parameters factors on the 3 axes: (a) Euclidean gradient, (b) associated watershed, (c) gradient supremum, (d) associated (a) watershed, (e) weighted sum gradient, (f) associated watershed. For visualization, gradients are scaled by a Gradient f ( x ) factor. c ( x ) ∇ Watershed Both segmentations (fig. 12), with the gradient p( x ) supremum and the Euclidean gradient, are not good, Clustering mrks( x ) c ( x ) compared to the reference. This is due to the leaks β seg( x ) on the gradients for the glue occlusions. In fact the morphological gradient on the factors on the third axis (b) 7 NOYEL G et al.: Morphological segmentation of hyperspectral images Fig. 14. (a) Flowchart of different transformations: reduction approach is necessary. For the current image, data denoising and reduction, (b) diagram for the data reduction based on a model is better than Watershed segmentation. the one based on factor correspondence analysis. In fact, for an hyperspectral image, it is better to use a In this paper we have considered four model, when it can be fitted, because it reduces the multidimensional spaces for image segmentation (fig. image entropy while it keeps the inner data structure. 14): Besides, the choice of pertinent parameters with low noise contribution is crucial for segmentation quality. • space 1: the image space f (x) after image filtering by FCA; Moreover, multivariate gradients behave better than any marginal gradient on parameters. The • space 2: the factorial space of image c (x) after multivariate gradients are based on an adapted distance image filtering and data reduction using FCA; to the considered space and on the supremum, • space 3: the parameters space p(x) after image or weighted sum, of morphological gradients on filtering by FCA and data reduction by model channels. The two kinds of gradients give similar fitting; results. Besides, to obtain relevant segmentations, they must be applied on a space with a low level of • space 4: the factors parameters space c (x) after noise. This underlines the importance of a pertinent image filtering by FCA, data reduction by model choice for parameters factors. About the markers, the fitting and parameters orthogonalisation by PCA. corresponding spaces to compute them must be also These spaces can be grouped in two different with a low level of noise, to get pertinent ones. approaches. The first one is data reduction by FCA. In conclusion, a relevant multivariate segmentation Space 2 belongs to this approach. The second approach requires an adapted data reduction, which gives reduces data by model fitting. Spaces 3 and 4 belongs parameters or factors with a low level of noise, is to this approach. Space 1 provides a direct approach to crucial ; a necessary condition to get pertinent markers be compared to the others. and gradients. On each space, the same method of segmentation In the future, we will develop multivariate filtering can be applied. First of all, a filtering is done on on spectral bands. More precisely, we will focus on image f (x) using FCA. Then the components of the levelings. They are usually necessary to enhance the spaces are generated: f (x), c (x), p(x), c (x). the functions on which are computed the gradients. These components generate new hyperspectral images As for greyscale images, we will define new types corresponding to the components space. In each space, of multivariate levelings. They will be adapted to the same method is applied on hyperspectral images. peculiarities of these functions and they will also The segmentation combines a spectral and a spatial simultaneously filter all the spectral channels of part. The spectral part consists of a classification in hyperspectral images. the considered space to obtain the markers. The spatial In the present example we have only used a simple part consists in computing a gradient on hyperspectral approach for markers extraction, i.e. a clustering by images (fig. 14). Then, with the markers of the spectral "Clara". It is necessary to test other classification part and the gradient of the spatial part, a watershed methods combining spectral and spatial information segmentation is performed on the considered space of in order to improve markers detection. We are hyperspectral images. considering to do clustering with lambda flat zones and clustering after a principal coordinates analysis, using a weight/distance matrix (Benzécri, 1973; Gower, CONCLUSION AND PERSPEC- 1966). TIVES REFERENCES This paper has presented a watershed-based segmentation for hyperspectral images. This approach Angulo J, Serra J (2003). Color segmentation by combines a spectral part (the markers) and a spatial ordered mergings. In: Proc. 2003 International part (the gradient). Conference on Image Processing, vol. 2. Benzécri J (1973). L’Analyse des Données. L’Analyse A temporal series example is used to illustrate des Correspondances, vol. 2. Paris: Dunod. our methodology. Comparing the results obtained for the various segmentations and the reference Beucher S, Meyer F (1993). The morphological of Legrand et al. (2002), it is obvious that a data approach to segmentation: The watershed 8 Image Anal Stereol ?? (Please use \volume):1-9 transformation. In: Dougherty E, ed., Math. 2004. 2004 IEEE International Geoscience and Morphology in Image Process. New York, NY, Remote Sensing Symposium, vol. 4. USA: Marcel Dekker. Meyer F (1992). Color image segmentation. In: 1992 Evans AN, Liu XU (2006). A morphological International Conference on Image Processing and gradient approach to color edge detection. IEEE its Applications. Transactions on Image Processing 15:1454–63. Meyer F (2001). An overview of morphological Flouzat G, Amram O, Cherchali S (1998). Spatial and segmentation. International Journal of Pattern spectral segmentation of satellite remote sensing Recognition and Artificial Intelligence 15:1089– imagery using processing graphs by mathematical morphology. In: IGARSS ’98. 1998 IEEE Meyer F (2004). Levelings, image simplification International Geoscience and Remote Sensing. filters for segmentation. Journal of Mathematical Symposium Proceedings, vol. 4. Imaging and Vision 20:59–72. Gower J (1966). Some distance properties of latent Paclík P, Duin R, van Kempen G, Kohlus R (2003). root and vector methods used in multivariate Segmentation of multi-spectral images using the analysis. Biometrika 53:325–38. combined classifier approach. Image and Vision Green AA, Berman M, Switzer P, Craig MD (1988). Computing 21:473 – 482. A transformation for ordering multispectral data in Scheunders P (2001). Multivalued image segmentation terms of image quality with implications for noise based on first fundamental form. In: Proceedings removal. IEEE Transactions on Geoscience and 11th International Conference on Image Analysis Remote Sensing 26:65–74. and Processing. Kaufman L, Rousseeuw P (1990). Finding Groups in Serra J, Cressie N (1982). Image Analysis and Data: An Introduction to Cluster Analysis, chap. 2 Mathematical Morphology, vol. 1. London: and 3. John Wiley & Sons, Ltd, 28–160. Academic. Legrand AC, Meriaudeau F, Gorria P (2002). Active Soille P (1996). Morphological partitioning of infrared non-destructive testing for glue occlusion multispectral images. Journal of Electronic detection within plastic lids. NDT E International Imaging 5:252 – 265. 35:177 – 187. Li P, Xiao X (2004). Evaluation of multiscale Soille P (2003). Morphological Image Analysis: Principles and Applications. New York: Springer- morphological segmentation of multispectral imagery for land cover classification. In: IGARSS Verlag, 2nd ed. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Electrical Engineering and Systems Science arXiv (Cornell University)

Morphological segmentation of hyperspectral images

Loading next page...
 
/lp/arxiv-cornell-university/morphological-segmentation-of-hyperspectral-images-ODCPUcfxZr

References (17)

ISSN
1854-5165
eISSN
ARCH-3348
DOI
10.5566/ias.v26.p101-109
Publisher site
See Article on Publisher Site

Abstract

Submitted to Image Anal Stereol, 9 pages Original Research Paper GUILLAUME NOYEL, JESÚS ANGULO AND DOMINIQUE JEULIN Centre de Morphologie Mathématique, Ecole des Mines de Paris, 35 rue Saint-Honoré, Fontainebleau, F–77305, France e-mail: {guillaume.noyel, jesus.angulo, dominique.jeulin}@ensmp.fr (Submitted) ABSTRACT The present paper develops a general methodology for the morphological segmentation of hyperspectral images, i.e. with an important number of channels. This approach, based on watershed, is composed of a spectral classification to obtain the markers and a vectorial gradient which gives the spatial information. Several alternative gradients are adapted to the different hyperspectral functions. Data reduction is performed either by Factor Analysis or by model fitting. Image segmentation is done on different spaces: factor space, parameters space, etc. On all these spaces the spatial/spectral segmentation approach is applied, leading to relevant results on the image. Keywords: factor analysis, hyperspectral imagery, mathematical morphology, watershed segmentation. INTRODUCTION Watershed segmentation requires a gradient (i.e. a scalar function) and markers on the target structures to obtain a correct image segmentation Hyperspectral images are multivariate discrete (Beucher and Meyer, 1993). A gradient on a functions with typically several tens or hundreds multivariate function can be obtained in different of spectral bands. In a formal way, each pixel of ways. One way is to calculate on each image channel an hyperspectral image is a vector with values in a modulus of a gradient, and to take the sum wavelength, in time, or associated with any index j. To or the supremum of the gradients (Meyer, 1992; each wavelength, time or index corresponds an image Angulo and Serra, 2003). Another way is to use in two dimensions called channel. In the sequel we vectorial gradients based on distance between vector use only the term of spectrum and spectral channel. pixels (Angulo and Serra, 2003; Evans and Liu, 2006). The number of channels depends on the nature of We consider here various alternatives for hyperspectral the specific problem under study (satellite imaging, images. spectroscopic images, temporal series, etc.). Let Moreover, when dealing with hyperspectral E → T images, the large number of channels generates data f : x → f (x) = f (x), f (x),..., f (x) redundancies. Consequently, it is necessary to reduce λ λ λ λ 1 2 L (1) the amount of data, to extract pertinent information. To be an hyperspectral image, where: do this, two ways are explored: a linear factor analysis and a model approach. 2 L •E ⊂ R , T ⊂ R and T = T ×T × ...×T Previously in the literature, several approaches •x = x \ i ∈ {1,2,... ,P} is the spatial coordinates of to multispectral image segmentation were explored. a vector pixel f (x ) (P is the pixels number of E) λ Flouzat et al. (1998) use a spatial and a spectral segmentation based on the filtering of the image • f \ j ∈ {1,2,... ,L} is a channel (L is the channels adjacency graph. Paclík et al. (2003) obtain, with number) statistical classifiers, the pixels probabilities of membership to clusters for spectral domain and • f (x ) is the value of vector pixel f (x ) on channel i i λ λ the pixels probabilities of membership to clusters f . for spatial domain. The pixels probabilities of In this paper, we introduce a general methodology membership to a cluster are obtained by multiplying for hyperspectral image segmentation, using both probabilities, because they assume independence a watershed based approach. The watershed between spatial and spectral information. The pixels transformation is a powerful tool for mathematical are classified and the process is repeated until morphology segmentation (Serra and Cressie, 1982; convergence. Li and Xiao (2004) compute on each Soille, 2003). channel a morphological multiscale gradient by arXiv:2010.00853v1 [eess.IV] 2 Oct 2020 NOYEL G et al.: Morphological segmentation of hyperspectral images summation of morphological gradients with increasing FRAMEWORK FOR MORPHO- size structuring elements. As watershed requires LOGICAL SEGMENTATION ON a scalar gradient (i.e. one channel), the channels MULTIVARIATE DATA gradients are summed with a weight equal to one. After morphological filtering on the gradient, the The watershed transformation is one of the most local minima are used as markers for watershed powerful tools for segmenting images. According to segmentation. Scheunders (2001) computes a gradient a flooding paradigm, the watershed lines associate a by summation of channels gradients followed by catchment basin to each minimum of the function a watershed segmentation. Soille (1996) combines (Beucher and Meyer, 1993). Typically, the function spectral classification on histograms and spatial to flood is a gradient function which defines the segmentation. The multidimensional histogram is transitions between the regions. Using the watershed segmented, using the watershed algorithm, to obtain on a scalar image without any preparation leads to a a classified image. On the classified image the minima strong over-segmentation (large number of minima). of the gradient of the hyperspectral image are imposed. There are two alternatives in order to get rid of the With the gradient and the markers he applies the over-segmentation. The first one consists in initially watershed segmentation. determining markers for each region of interest: using The methodology and the different alternatives the homotopy modification, the local minima of the studied in the current paper are illustrated by means of gradient function are only the region markers. A a 60 channels image acquired by active thermography difficult issue is to determine the markers, especially on plastic lids. The size of the image is 256 × 256 for generic images. The second alternative involves pixels × 60 channels. The aim is to segment glue hierarchical approaches based on non-parametric occlusions within plastic lids. This sequence of images merging of catchment basins (waterfall algorithm) comes from Laboratoire Le2i, Le Creusot, France. or based on the selection of the most significant Legrand et al. (2002) explain how the image was minima according to different criteria (dynamics, area acquired. They also present a segmentation that was or volume extinction values) (Meyer, 2001). done on a channel, using difference of lid images In this paper, we focus on markers based with and without glue, thresholding and filtering. Their segmentation. In fact, we consider that the segmentation is used as a reference for comparison hyperspectral images have enough information to (fig. 1). In our case, only the sequence with glue define markers from a spectral classification. occlusions is available. That’s why we cannot use image difference or any kind of calibration with a Multivariate gradients reference image. A gradient image, in fact the norm, is a scalar function with values in the reduced interval [0,1], i.e. ∇ : E → [0,1]. This normalization is always applied to multivariate gradients given below in order to have homogeneous gradient functions. To define a gradient, four approaches are considered: a morphological gradient on one channel, a metric-based gradient on all channels, a gradient defined as the supremum, or as the sum, of morphological gradients on each channel. The morphological gradient is a marginal gradient f f (i.e. it can only be applied on scalar images) defined λ λ 1 30 as the difference between the channel dilation and erosion with a structuring element B which is the neighborhood of point x ∈ E (Serra and Cressie, 1982): g( f (x)) = δ ( f (x))−ε ( f (x)) (2) λ B λ B λ x x j j j = ∨ ( f (x))−∧ ( f (x)) B λ B λ x x j j The gradient supremum of morphological f reference gradients on each channel is a vectorial gradient defined as: Fig. 1. Three channels of the original image and the reference obtained by Legrand et al. (2002) method. ∇ f (x) = ∨[g( f (x)), j ∈ {1,... ,L}] (3) ∨ λ λ 2 Image Anal Stereol ?? (Please use \volume):1-9 Each morphological gradient must be normalized Markers by spectral clustering between [0,1] before taking the supremum. The markers defining the targets are obtained with an unsupervised classification based on clustering. We The gradient weighted sum of morphological have used in this study the clustering algorithm "Clara" gradients is given by: (Kaufman and Rousseeuw, 1990). This is a similar way, but more robust than the "kmeans" classification, ∇ f (x) = w g( f (x)) (4) + λ ∑ λ λ j j in order to cluster large numbers of points. Then, the j=1 pertinent clusters are selected to be the markers. To perform clustering, each channel is considered as a where w denotes the weight of the gradient of variable. Therefore each pixel has its own value on channel f . each variable. The metric-based gradient is a vectorial gradient defined as the difference between the supremum and the infimum of a defined distance on a unit DATA REDUCTION AND FILTERING neighbourhood B(x): USING FACTOR ANALYSIS ∇ f (x) = ∨[d(f (x),f (y)),y ∈ B(x)]− λ λ λ Due to the redundancy of channels, a data ∧ [d(f (x),f (y)),y ∈ B(x)] λ λ reduction is performed using Factor Correspondence . (5) Analysis (FCA) (Benzécri, 1973). We prefer an FCA in place of a Principal Component Analysis because Various metric distances are available for this gradient image values are positive and the spectral channels such as: can be considered as probability distributions. The metric used in FCA is the chi-squared normalized by •Euclidean distance: channels weight. This metric is adapted to probability laws. FCA can be seen as a transformation from image t 2 space to factorial space (eq. 10). In factorial space d (f (x),f (y)) = ( f (x)− f (y)) (6) E λ λ ∑ λ λ j j the coordinates of the pixels vector on each factorial j=1 axis are called pixels factors. The pixels factors can be considered as an hyperspectral image whose channels •Mahalanobis distance: correspond to factorial axes: d (f (x),f (y)) = M L K λ λ T → T / K < L ζ : f f f t −1 f (x) → c (x) = c (x),...,c (x) (f (x)− f (y)) Σ (f (x)− f (y)) (7) λ α α α λ λ λ λ 1 (10) A limited number K of factorial axes is usually chosen. where Σ is the covariance matrix between variables Therefore FCA can be seen as a projection of initial (channels) of f . If channels are uncorrelated, pixels in a factor space with a smaller dimension. the covariance matrix is diagonal. The diagonal values are equal to channels variance σ \ j ∈ The pseudo-inverse transform consists in {1,2,... ,L}. Therefore, the Mahalanobis distance reconstructing the images from factors (eq. 11). This is an approximation of the original image if one keeps becomes: a part of factorial axes for the reconstruction: u L f (x)− f (y) K L λ λ j j T → T / K < L −1 d (f (x),f (y)) = b λ λ ∑ ζ : b b b c (x) → f (x) = f (x),... , f (x) j=1 j α λ λ λ 1 L (8) (11) Besides, hyperspectral images usually contain noise •chi-squared distance: due to the acquisition device, compression, etc. In this case it is possible to use FCA to filter images. As d (f (x ),f (x ′)) = λ i λ i shown by Green et al. (1988), the noise is rejected on u L f (x ) f (x ′) the last factorial axes whereas the signal remains on N λ i λ i j j − (9) ∑ the first axes. By keeping only axes with sufficient f f f .λ x . x . i ′ j=1 j signal and reconstructing the image, all channels are filtered. In our example, the image is very noisy ; P J with f = f (x ), f = f (x ) and ∑ ∑ i x . i .λ i=1 λ i j=1 λ j j j consequently better results are obtained by filtering L P N = f (x ). the whole sequence with a FCA, keeping the two ∑ ∑ λ i j=1 i=1 3 NOYEL G et al.: Morphological segmentation of hyperspectral images first factorial axes (fig. 2). The eigenvalues associated The Euclidean distance in FCA factorial space is −4 with these two factors are μ = 13.9 10 and μ = equivalent to the chi-squared distance in image space 1 2 −4 3.15 10 . In other words, the first axis represent (Benzécri, 1973). Therefore a chi-squared distance 13.8% of inertia and the second one 3.1%. Therefore, based gradient ∇ f (x) is performed on the filtered the inertia of the two first axes is equal to 16.9% image f (x) and an Euclidean distance based gradient which is small. In fact the next axes contain a lot of f f ∇ c (x) on the FCA factors c (x). Then the watershed α α noise. This explains why their share in inertia is high. segmentation is computed (fig. 4 and 5). Both Therefore, they must be removed to get information segmentations, compared to the reference model (fig. without noise. 1), are not satisfactory for the present image. f f λ λ 50 50 (a) (b) Fig. 2. f and f are the channel 50 before and after λ λ 50 50 filtering by FCA. SEGMENTATION OF f (x), c (x) It is possible to generate a segmentation on the (c) (d) hyperspectral image composed of factorial axes c (x) (fig. 3) or on the filtered image f (x). Fig. 4. Processes are computed on the filtered image f (x). (a) Clara segmentation, (b) Green cluster corresponding to glue used as markers, (c) Chi- squared gradient, (d) Watershed segmentation. For visualization, gradients are scaled by a factor. f f c (x) c (x) α α 1 2 Fig. 3. FCA factors on axes 1 and 2 of original image. For visualization, factors are scaled by a factor. In the factorial space made up of the two first axes, (a) (b) a classification by "Clara" is processed. Then the green cluster corresponding to glue is selected defining the markers (fig. 5). In order to regularize these markers, an opening with an hexagonal structuring element of size 5 is applied. As differences between glue and lid are small, a gaussian filter of size 11 followed by a morphological leveling are applied on each channel, to (c) (d) enhance the contours and to obtain a better gradient. The levelings are a subclass of symmetric connected filters (or filters by reconstruction) that suppress Fig. 5. Processes are computed on the factor details but preserve the contours of the remaining pixels c (x). (a) Clara segmentation, (b) Green objects (Meyer, 2004). The levelings need an image cluster corresponding to glue used as markers, (c) marker, a rough simplification of the reference image, Euclidean gradient, (d) Watershed segmentation. For to determine the structures to be leveled. visualization, gradients are scaled by a factor. 4 Image Anal Stereol ?? (Please use \volume):1-9 DATA REDUCTION USING MODEL by PCA (fig 7). In this case the different axes represent the following inertia ratios 97.24%, 2.10% APPROACH and 0.66%. Another way to reduce data is to fit a model on the spectrum of each pixels vector. The parameters of the model fitted in each pixel are seen as parametrical cartographies or maps. The whole maps generate an hyperspectral image p(x) = (p (x),... , p (x)). This 1 M approach is advantageous in the way it takes the order of channels into account. In fact, in FCA channels the order is without importance. p = a p = b p = m 1 2 3 Moreover, with the hyperspectral image of parameters, a segmentation can be computed. It is also possible to make parameters orthogonal with a Principal Component Analysis and then generating a segmentation. Principal Component Analysis (PCA) is used here p p p axis 1 c axis 2 c axis 3 c instead of FCA, because it is possible to compute β β β 1 2 3 it on hyperspectral images with negative values, which can be the case for some parameters. PCA Fig. 7. Maps of the parameters of the linear model, PCA factors of the parameters on axis 1, 2 and 3.. gives factorial axes with factors building another p p p hyperspectral image: c (x) = (c (x),... ,c (x)). β β β 1 M SEGMENTATION OF p(x) OR c (x) For this thermographic sequence, a linear model is fitted on the image after removing the 10 first channels Different approaches of segmentation are tested which correspond to a transitory phenomenon (fig. 6). on parameters p(x) or on parameters factors c (x). The linear model y = ax + b has two parameters, the Markers are computed again by the cluster method slope a and the intercept b. On the first 10 channels we "Clara" on the parameters and the image of factors . have defined another parameter, called rise m, as the First, a clustering is processed on both images. The maximum amplitude on these 10 channels: cluster corresponding to the lid center is selected because the glue is on the lid center. A second b b m(x) = max ( f (x))− min ( f (x))). (12) λ λ j j clustering "Clara" is made on the selected cluster. Non j∈[1:10] j∈[1:10] selected pixels are aggregated to the cluster of the largest size, because cluster corresponding to glue has the smallest size (fig. 8). (a) (b) (a) (b) (c) (d) Fig. 6. (a) Point outside glue where is measured (c) (d) spectrum (b), (c) point inside glue and corresponding spectrum (d). Fig. 8. (a) Clara segmentation in 4 clusters on Then with the linear model we obtain images as parameter b, blue cluster is selected, (b) Clara on maps of the parameters, which can be orthogonalised parameters a and m: parameters markers, (c) Clara 5 NOYEL G et al.: Morphological segmentation of hyperspectral images segmentation in 3 clusters on first axis c , green A metric-based gradient with the Mahalanobis p p distance ∇ p(x), and a gradient supremum of cluster is selected, (d) Clara on axes 2 and 3 (c , c ): β β 2 3 channels gradient ∇ p(x) are tested on the parameters parameters factors markers. image (fig. 10). In this case the gradient sum ∇ p(x) is To improve the quality of gradients, each image approximatively equivalent to the supremum gradient channel is again leveled using as image markers the because it is not possible to define specific weights for corresponding channels, filtered by a gaussian kernel. the parameters. For each case, the same markers are Then, several gradients are tested. The morphological used. Moreover, to compute the Mahalanobis distance, gradient on each channel g, the supremum and the sum we assume that parameters are uncorrelated. of morphological gradients, ∇ and ∇ , are evaluated ∨ + on the image of parameters p(x) and on the image of PCA factors parameters c (x). Besides the Euclidean distance in PCA factorial space is equivalent to the Mahalanobis distance in parameters space. Therefore, the Mahalanobis distance based gradient ∇ p(x) is performed on the parameters p(x) to ensure the equal statistical value for the different parameters. For the (a) (b) PCA factors parameters c (x), the most indicated is the Euclidean distance based gradient. Watershed on parameters The morphological gradient is computed on each channel of image p(x). Markers (fig. 8 (b)) are filtered (c) (d) by opening with an hexagonal structuring element of size 5. With the gradient and the markers, a watershed Fig. 10. Segmentations on parameters: (a) segmentation is obtained for each parameter. Mahalanobis distance based gradient, (b) associated watershed, (c) gradients supremum, (d) associated watershed. For visualization, gradients are scaled by a factor. Both segmentations from a vectorial gradient are good, compared to the reference. Consequently vectorial gradients are good in both cases. Watershed on PCA axes of parameters As for parameters, a morphological gradient is computed on each channel of c (x). The markers (fig. 8 (d)) are again regularized with an opening followed by the corresponding watershed of each gradient. The resulting segmentations on the parameters a b m p p factors on axes 1, c , and 2, c , are good, β β 1 2 as compared to the reference (fig. 11). In fact Fig. 9. First line: morphological gradient, second line: their gradients have distinct contours without leaks. watershed on parameters: slope a, intercept b and rise However, it is not the case for morphological gradient m. For visualization, gradients are scaled by a factor. on the parameters factors on axes 3, c . Moreover, as Comparing to the reference, segmentations with for parameters, vectorial gradients are also tested. morphological gradients on parameters slope a and rise p First of all, an Euclidean gradient ∇ c (x) is m are good. However, the segmentation on intercept tested. Then the supremum of channels gradient b is not satisfactory, due to the leaks on the gradient. p p ∇ c (x) and the weighted sum gradient ∇ c (x) are ∨ + β β Although these segmentations are pertinent, they are used (fig. 12). The weights for ∇ c (x) are equal to the only marginal segmentations, i.e. only one parameter + is taken into account in one segmentation. Therefore, inertia contributions of axes: 0.97, 0.021 and 0.0066. we have tested the use of a vectorial gradient. For each case the same markers are used. 6 Image Anal Stereol ?? (Please use \volume):1-9 of PCA parameters is not relevant (fig. 11). However, the weighted sum gradient is much better because the weight the third axis is very low compared to the other ones. In this case the weighted sum gradient is more adapted. Consequently, the Euclidean gradient and the supremum of morphological gradients are tested on the two first PCA parameters axes (fig. 13). In this case, the segmentations are much better. Therefore, the choice of axes for which the gradient is better must be emphasized. In fact, adding another noisy axis creates leaks on the gradient. axis 1 axis 2 axis 3 Fig. 11. Morphological gradient and watershed on p p factors of PCA parameters: axis 1 c , axis 2 c and β β 1 2 axis 3 c . For visualization, gradients are scaled by a factor. (a) (b) (c) (d) (a) (b) Fig. 13. Segmentations on PCA parameters factors on axes 1 and 2: (a) Euclidean gradient, (b) associated watershed, (c) gradient supremum, (d) associated watershed. For visualization, gradients are scaled. (c) (d) OVERVIEW OF METHODS -1 f −1 f ( x ) FCA ζ FCA λ ζ c ( x ) (e) (f) c ( x ) PCA f ( x ) ζ p( x ) Modeling Fig. 12. Segmentations on PCA parameters factors on the 3 axes: (a) Euclidean gradient, (b) associated watershed, (c) gradient supremum, (d) associated (a) watershed, (e) weighted sum gradient, (f) associated watershed. For visualization, gradients are scaled by a Gradient f ( x ) factor. c ( x ) ∇ Watershed Both segmentations (fig. 12), with the gradient p( x ) supremum and the Euclidean gradient, are not good, Clustering mrks( x ) c ( x ) compared to the reference. This is due to the leaks β seg( x ) on the gradients for the glue occlusions. In fact the morphological gradient on the factors on the third axis (b) 7 NOYEL G et al.: Morphological segmentation of hyperspectral images Fig. 14. (a) Flowchart of different transformations: reduction approach is necessary. For the current image, data denoising and reduction, (b) diagram for the data reduction based on a model is better than Watershed segmentation. the one based on factor correspondence analysis. In fact, for an hyperspectral image, it is better to use a In this paper we have considered four model, when it can be fitted, because it reduces the multidimensional spaces for image segmentation (fig. image entropy while it keeps the inner data structure. 14): Besides, the choice of pertinent parameters with low noise contribution is crucial for segmentation quality. • space 1: the image space f (x) after image filtering by FCA; Moreover, multivariate gradients behave better than any marginal gradient on parameters. The • space 2: the factorial space of image c (x) after multivariate gradients are based on an adapted distance image filtering and data reduction using FCA; to the considered space and on the supremum, • space 3: the parameters space p(x) after image or weighted sum, of morphological gradients on filtering by FCA and data reduction by model channels. The two kinds of gradients give similar fitting; results. Besides, to obtain relevant segmentations, they must be applied on a space with a low level of • space 4: the factors parameters space c (x) after noise. This underlines the importance of a pertinent image filtering by FCA, data reduction by model choice for parameters factors. About the markers, the fitting and parameters orthogonalisation by PCA. corresponding spaces to compute them must be also These spaces can be grouped in two different with a low level of noise, to get pertinent ones. approaches. The first one is data reduction by FCA. In conclusion, a relevant multivariate segmentation Space 2 belongs to this approach. The second approach requires an adapted data reduction, which gives reduces data by model fitting. Spaces 3 and 4 belongs parameters or factors with a low level of noise, is to this approach. Space 1 provides a direct approach to crucial ; a necessary condition to get pertinent markers be compared to the others. and gradients. On each space, the same method of segmentation In the future, we will develop multivariate filtering can be applied. First of all, a filtering is done on on spectral bands. More precisely, we will focus on image f (x) using FCA. Then the components of the levelings. They are usually necessary to enhance the spaces are generated: f (x), c (x), p(x), c (x). the functions on which are computed the gradients. These components generate new hyperspectral images As for greyscale images, we will define new types corresponding to the components space. In each space, of multivariate levelings. They will be adapted to the same method is applied on hyperspectral images. peculiarities of these functions and they will also The segmentation combines a spectral and a spatial simultaneously filter all the spectral channels of part. The spectral part consists of a classification in hyperspectral images. the considered space to obtain the markers. The spatial In the present example we have only used a simple part consists in computing a gradient on hyperspectral approach for markers extraction, i.e. a clustering by images (fig. 14). Then, with the markers of the spectral "Clara". It is necessary to test other classification part and the gradient of the spatial part, a watershed methods combining spectral and spatial information segmentation is performed on the considered space of in order to improve markers detection. We are hyperspectral images. considering to do clustering with lambda flat zones and clustering after a principal coordinates analysis, using a weight/distance matrix (Benzécri, 1973; Gower, CONCLUSION AND PERSPEC- 1966). TIVES REFERENCES This paper has presented a watershed-based segmentation for hyperspectral images. This approach Angulo J, Serra J (2003). Color segmentation by combines a spectral part (the markers) and a spatial ordered mergings. In: Proc. 2003 International part (the gradient). Conference on Image Processing, vol. 2. Benzécri J (1973). L’Analyse des Données. L’Analyse A temporal series example is used to illustrate des Correspondances, vol. 2. Paris: Dunod. our methodology. Comparing the results obtained for the various segmentations and the reference Beucher S, Meyer F (1993). The morphological of Legrand et al. (2002), it is obvious that a data approach to segmentation: The watershed 8 Image Anal Stereol ?? (Please use \volume):1-9 transformation. In: Dougherty E, ed., Math. 2004. 2004 IEEE International Geoscience and Morphology in Image Process. New York, NY, Remote Sensing Symposium, vol. 4. USA: Marcel Dekker. Meyer F (1992). Color image segmentation. In: 1992 Evans AN, Liu XU (2006). A morphological International Conference on Image Processing and gradient approach to color edge detection. IEEE its Applications. Transactions on Image Processing 15:1454–63. Meyer F (2001). An overview of morphological Flouzat G, Amram O, Cherchali S (1998). Spatial and segmentation. International Journal of Pattern spectral segmentation of satellite remote sensing Recognition and Artificial Intelligence 15:1089– imagery using processing graphs by mathematical morphology. In: IGARSS ’98. 1998 IEEE Meyer F (2004). Levelings, image simplification International Geoscience and Remote Sensing. filters for segmentation. Journal of Mathematical Symposium Proceedings, vol. 4. Imaging and Vision 20:59–72. Gower J (1966). Some distance properties of latent Paclík P, Duin R, van Kempen G, Kohlus R (2003). root and vector methods used in multivariate Segmentation of multi-spectral images using the analysis. Biometrika 53:325–38. combined classifier approach. Image and Vision Green AA, Berman M, Switzer P, Craig MD (1988). Computing 21:473 – 482. A transformation for ordering multispectral data in Scheunders P (2001). Multivalued image segmentation terms of image quality with implications for noise based on first fundamental form. In: Proceedings removal. IEEE Transactions on Geoscience and 11th International Conference on Image Analysis Remote Sensing 26:65–74. and Processing. Kaufman L, Rousseeuw P (1990). Finding Groups in Serra J, Cressie N (1982). Image Analysis and Data: An Introduction to Cluster Analysis, chap. 2 Mathematical Morphology, vol. 1. London: and 3. John Wiley & Sons, Ltd, 28–160. Academic. Legrand AC, Meriaudeau F, Gorria P (2002). Active Soille P (1996). Morphological partitioning of infrared non-destructive testing for glue occlusion multispectral images. Journal of Electronic detection within plastic lids. NDT E International Imaging 5:252 – 265. 35:177 – 187. Li P, Xiao X (2004). Evaluation of multiscale Soille P (2003). Morphological Image Analysis: Principles and Applications. New York: Springer- morphological segmentation of multispectral imagery for land cover classification. In: IGARSS Verlag, 2nd ed.

Journal

Electrical Engineering and Systems SciencearXiv (Cornell University)

Published: Oct 2, 2020

There are no references for this article.