Please use this identifier to cite or link to this item:
Title: Accelerating the quadratic lower-bound algorithm via optimizing the shrinkage parameter
Authors: Tian, GL
Tang, ML
Liu, C 
Keywords: Cox proportional hazards model
EM-type algorithms
Logistic regression
Newton-Raphson algorithm
Optimal QLB algorithm
QLB algorithm
Issue Date: 2012
Publisher: Elsevier Science Bv
Source: Computational statistics and data analysis, 2012, v. 56, no. 2, p. 255-265 How to cite?
Journal: Computational Statistics and Data Analysis 
Abstract: When the Newton-Raphson algorithm or the Fisher scoring algorithm does not work and the EM-type algorithms are not available, the quadratic lower-bound (QLB) algorithm may be a useful optimization tool. However, like all EM-type algorithms, the QLB algorithm may also suffer from slow convergence which can be viewed as the cost for having the ascent property. This paper proposes a novel 'shrinkage parameter' approach to accelerate the QLB algorithm while maintaining its simplicity and stability (i.e., monotonic increase in log-likelihood). The strategy is first to construct a class of quadratic surrogate functions Q r(θ|θ (t)) that induces a class of QLB algorithms indexed by a 'shrinkage parameter' r (r∈R) and then to optimize r over R under some criterion of convergence. For three commonly used criteria (i.e., the smallest eigenvalue, the trace and the determinant), we derive a uniformly optimal shrinkage parameter and find an optimal QLB algorithm. Some theoretical justifications are also presented. Next, we generalize the optimal QLB algorithm to problems with penalizing function and then investigate the associated properties of convergence. The optimal QLB algorithm is applied to fit a logistic regression model and a Cox proportional hazards model. Two real datasets are analyzed to illustrate the proposed methods.
DOI: 10.1016/j.csda.2011.07.013
Appears in Collections:Journal/Magazine Article

View full-text via PolyU eLinks SFX Query
Show full item record

Page view(s)

Last Week
Last month
Citations as of Oct 15, 2018

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.