A Non-Parametric Bootstrap for Spectral Clustering (2209.05812v2)
Abstract: Finite mixture modelling is a popular method in the field of clustering and is beneficial largely due to its soft cluster membership probabilities. A common method for fitting finite mixture models is to employ spectral clustering, which can utilize the expectation-maximization (EM) algorithm. However, the EM algorithm falls victim to a number of issues, including convergence to sub-optimal solutions. We address this issue by developing two novel algorithms that incorporate the spectral decomposition of the data matrix and a non-parametric bootstrap sampling scheme. Simulations display the validity of our algorithms and demonstrate not only their flexibility, but also their computational efficiency and ability to avoid poor solutions when compared to other clustering algorithms for estimating finite mixture models. Our techniques are more consistent in their convergence when compared to other bootstrapped algorithms that fit finite mixture models.
- Andrews, J. L. (2018). Addressing overfitting and underfitting in gaussian model-based clustering. Computational Statistics & Data Analysis, 127:160–171.
- Model-based classification via mixtures of multivariate t-distributions. Computational Statistics & Data Analysis, 55(1):520–529.
- Model-based gaussian and non-gaussian clustering. Biometrics, pages 803–821.
- Model-based clustering of high-dimensional data: A review. Computational Statistics & Data Analysis, 71:52–78.
- Unsupervised learning algorithms. Springer.
- Gaussian parsimonious clustering models. Pattern recognition, 28(5):781–793.
- Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39(1):1–22.
- Monitor ionizing radiation-induced cellular responses with raman spectroscopy, non-negative matrix factorization, and non-negative least squares. Applied spectroscopy, 74(6):701–711.
- Efron, B. (1981). Nonparametric estimates of standard error: the jackknife, the bootstrap and other methods. Biometrika, 68(3):589–599.
- Efron, B. (1982). The jackknife, the bootstrap and other resampling plans. SIAM.
- Mixtures of shifted asymmetriclaplace distributions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(6):1149–1157.
- Trajectories of symptom severity in children with autism: Variability and turning points through the transition to school. Journal of autism and developmental disorders, 52(1):392–401.
- The EM algorithm for mixtures of factor analyzers. Technical report, Technical Report CRG-TR-96-1, University of Toronto.
- Comparing partitions. Journal of classification, 2:193–218.
- Spectral algorithms. Foundations and Trends® in Theoretical Computer Science, 4(3–4):157–288.
- Clustering with spectral norm and the k-means algorithm. In 2010 IEEE 51st Annual Symposium on Foundations of Computer Science, pages 299–308. IEEE.
- Optimality of spectral clustering in the gaussian mixture model. The Annals of Statistics, 49(5):2506–2530.
- Radiation-induced glycogen accumulation detected by single cell raman spectroscopy is associated with radioresistance that can be reversed by metformin. PloS one, 10(8):e0135356.
- McCreery, R. L. (2005). Raman spectroscopy for chemical analysis. John Wiley & Sons.
- Mixtures of factor analyzers. In In Proceedings of the Seventeenth International Conference on Machine Learning. Citeseer.
- The EM algorithm and extensions. John Wiley & Sons.
- Finite mixture models. Annual review of statistics and its application, 6:355–378.
- McNicholas, P. D. (2016). Mixture model-based classification. Chapman and Hall/CRC.
- On spectral clustering: Analysis and an algorithm. Advances in neural information processing systems, 14.
- Parsimonious mixtures of multivariate contaminated normal distributions. Biometrical Journal, 58(6):1506–1537.
- A bootstrap-augmented alternating expectation-conditional maximization algorithm for mixtures of factor analyzers. Stat, 8(1):e243.
- Mixtures of probabilistic principal component analyzers. Neural computation, 11(2):443–482.
- Language identification using gaussian mixture model tokenization. In 2002 IEEE international conference on acoustics, speech, and signal processing, volume 1, pages I–757. IEEE.
- A spectral algorithm for learning mixture models. Journal of Computer and System Sciences, 68(4):841–860.
- Von Luxburg, U. (2007). A tutorial on spectral clustering. Statistics and computing, 17(4):395–416.
- Yu, J. (2012). Online quality prediction of nonlinear and non-gaussian chemical processes with shifting dynamics using finite mixture model based gaussian process regression approach. Chemical engineering science, 82:22–30.