Skip to Main content Skip to Navigation
New interface
Conference papers

Clustering with missing data: which imputation model for which cluster analysis method?

Abstract : Multiple imputation (MI) is a popular method for dealing with missing values. One main advantage of MI is to dissociate the imputation phase and the analysis one. However, both are related since they are based on distribution assumptions that have to be consistent. This point is well known as ``congeniality''. In this talk, we discuss congeniality of imputation models and clustering on continuous data. First, we theoretically highlight how two joint modelling (JM) MI methods, using either general location model (JM-GL) or Dirichlet process mixture (JM-DP), could be congenial with various clustering methods. Then, we propose a new fully conditional specification (FCS) MI method with the same theoretical properties as JM-GL. Finally, we extend this FCS MI method from normal distribution to account for more complex distributions. Based on an extensive simulation study, all MI methods are compared for various cluster analysis methods (k-means, k-medoids, mixture model, hierarchical clustering). This study highlights the partition accuracy is always improved when the imputation model accounts for clustered individuals. From this point of view, standard MI methods ignoring such a structure should be avoided. JM-GL and JM-DP should be recommended when data are distributed according to a Gaussian mixture model, while FCS methods outperform JM ones on data involving more complex distributions.
Document type :
Conference papers
Complete list of metadata

https://hal-cnam.archives-ouvertes.fr/hal-03693455
Contributor : Vincent Audigier Connect in order to contact the contributor
Submitted on : Friday, June 10, 2022 - 3:05:59 PM
Last modification on : Wednesday, September 28, 2022 - 5:58:52 AM

Identifiers

  • HAL Id : hal-03693455, version 1

Citation

Vincent Audigier, Ndèye Niang, Matthieu Resche-Rigon. Clustering with missing data: which imputation model for which cluster analysis method?. 17th conference of the International Federation of Classification Societies, Jul 2022, Porto, Portugal. ⟨hal-03693455⟩

Share

Metrics

Record views

30