A unified algorithm for principal and minor components extraction

Research output: Contribution to journalArticlepeer-review

81 Scopus citations

Abstract

Principal component and minor component extractions provide powerful techniques in many information-processing fields. However, by conventional algorithms minor component extraction is much more difficult than principal component extraction. A unified algorithm which can be used to extract both principal and minor component eigenvectors is proposed. This 'unified' algorithm can extract true principle components (eigenvectors) and if altered simply by the sign, it can also serve as a true minor components extractor. This is of practical significance in neural network implementation. It is shown how the present algorithms are related to Oja's principal subspace algorithm, Xu's algorithm and the Brockett flow. It is also shown that the algorithms are based on the natural gradient ascend/descent methods (a potential flow in a Riemannian space).

Original languageEnglish
Pages (from-to)385-390
Number of pages6
JournalNeural Networks
Volume11
Issue number3
DOIs
StatePublished - Apr 1998
Externally publishedYes

Keywords

  • Dynamical system
  • Minor component extraction
  • Natural gradient
  • Principal component extraction
  • Singular value decomposition

Fingerprint

Dive into the research topics of 'A unified algorithm for principal and minor components extraction'. Together they form a unique fingerprint.

Cite this