Differential geometric least angle regression: a differential geometric approach to sparse generalized linear models

Risultato della ricerca: Articlepeer review

16 Citazioni (Scopus)

Abstract

Sparsity is an essential feature of many contemporary data problems. Remote sensing, various forms of automated screening and other high throughput measurement devices collect a large amount of information, typically about few independent statistical subjects or units. In certain cases it is reasonable to assume that the underlying process generating the data is itself sparse, in the sense that only a few of the measured variables are involved in the process. We propose an explicit method of monotonically decreasing sparsity for outcomes that can be modelled by an exponential family. In our approach we generalize the equiangular condition in a generalized linear model. Although the geometry involves the Fisher information in a way that is not obvious in the simple regression setting, the equiangular condition turns out to be equivalent with an intuitive condition imposed on the Rao score test statistics. In certain special cases the method can be tweaked to obtain L1-penalized generalized linear model solution paths, but the method itself defines sparsity more directly. Although the computation of the solution paths is not trivial, the method compares favourably with other path following algorithms.
Lingua originaleEnglish
pagine (da-a)471-498
Numero di pagine28
RivistaJOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B STATISTICAL METHODOLOGY
Volume75
Stato di pubblicazionePublished - 2013

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint Entra nei temi di ricerca di 'Differential geometric least angle regression: a differential geometric approach to sparse generalized linear models'. Insieme formano una fingerprint unica.

Cita questo