Optimal Pooling of Covariance Matrix Estimates Across Multiple Classes

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
This publication is imported from Aalto University research portal.
View publication in the Research portal
View/Open full text file from the Research portal
Date
2018-09-10
Major/Subject
Mcode
Degree programme
Language
en
Pages
5
4224-4228
Series
2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings, Volume 2018-April, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing
Abstract
The paper considers the problem of estimating the covariance matrices of multiple classes in a low sample support condition, where the data dimensionality is comparable to, or larger than, the sample sizes of the available data sets. In such conditions' a common approach is to shrink the class sample covariance matrices (SCMs) towards the pooled SCM. The success of this approach hinges upon the ability to choose the optimal regularization parameter. Typically, a common regularization level is shared among the classes and determined via a procedure based on cross-validation. We use class-specific regularization levels since this enables the derivation of the optimal regularization parameter for each class in terms of the minimum mean squared error (MMSE). The optimal parameters depend on the true unknown class population covariances. Consistent estimators of the parameters can, however, be easily constructed under the assumption that the class populations follow (unspecified) elliptically symmetric distributions. We demonstrate the performance of the proposed method via a simulation study as well as via an application to discriminant analysis using both synthetic and real data sets.
Description
Keywords
Classification, Covariance matrix estimation, Elliptical distribution, Regularization
Other note
Citation
Raninen , E & Ollila , E 2018 , Optimal Pooling of Covariance Matrix Estimates Across Multiple Classes . in 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings . vol. 2018-April , 8461327 , Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing , IEEE , pp. 4224-4228 , IEEE International Conference on Acoustics, Speech, and Signal Processing , Calgary , Alberta , Canada , 15/04/2018 . https://doi.org/10.1109/ICASSP.2018.8461327