How to Obtain Asymptotic Covariance Matrices

Kristopher J. Preacher
University of Kansas

Patrick J. Curran and Daniel J. Bauer
University of North Carolina at Chapel Hill

Many times throughout these pages we have mentioned the asymptotic covariance matrix, or ACOV matrix. The ACOV matrix is the covariance matrix of parameter estimates. The ACOV matrix is also known variously as the ACM, the VCE (variance-covariance matrix of the estimators), or simply the inverse of the Fisher information matrix (denoted I(q)-1). Elements along the diagonal represent the variance expected of each parameter estimate over repeated sampling, and can be interpreted as indices of precision of estimation. Off-diagonal elements represent covariances of parameter estimates. The standard errors used to conduct significance tests of parameter estimates are simply the square roots of the diagonal elements of the ACOV matrix.

Some (but not all) of the elements of an ACOV matrix are necessary for the computation of standard errors associated with simple intercepts, simple slopes, and simple trajectories. Most statistical software packages provide ACOV matrices, but only if requested to do so. Below are instructions for how to obtain the ACOV matrix in several packages. This list is not exhaustive, but does cover most of the commonly used packages.

Multiple Linear Regression (MLR)

SAS PROC REG

Insert "ACOV" on the model statement in PROC REG after "\".

SPSS

In the "Linear Regression" window, click on the "Statistics" button. In the "Regression Coefficients" section, check the box for "Covariance matrix." The ACOV matrix will be included in the output once the regression analysis is run. In order to get variances and covariances associated with the intercept, the user must "trick" SPSS into thinking the intercept is a coefficient associated with a predictor variable. To do this, click on the "Options" button make sure the box marked "Include constant in equation" is not checked. Then create a new variable c, all of whose values are equal to 1.0. Include c as a predictor and run the regression analysis again. The variance and covariances associated with c in the ACOV matrix are those associated with the intercept term.

Hierarchical Linear / Mixed Effects / Multilevel Modeling (HLM/MLM)

MLwiN

In MLwiN, the asymptotic (co)variances of the fixed parameters are stored in column 99 of the data spreadsheet, and are updated after every iteration. Those for the random parameters are stored in column 97. The elements correspond to elements of the lower triangle of the ACOV matrix.

SAS PROC MIXED

Insert "COVB" on the model statement in PROC MIXED.

HLM

Before running the analysis, on the main menu choose Other Settings -> Output Settings and check the appropriate box.

Splus

...

LISREL

Use the "OPTIONS ACM=YES;" command in the syntax. Two ascii files will be created in the default directory: filename_fixed.acm and filename_random.acm.

SPSS

In SPSS's "Mixed models" analysis dialog, click on the "Statistics" button. Check the box marked "Covariances of parameter estimates." If syntax is used, add the line "/PRINT = COVB ." to the end. Parameter covariances will be reported in the Output window.

Latent Growth Curve Modeling / Latent Curve Analysis (LGM/LCA)

AMOS

Using the AMOS Graphics interface, specify the model as you normally would. From the "Analysis properties" menu, click on the "Output" tab. Check the box marked "Covariances of estimates." When the model is run, the ACOV matrix is reported in the output file after the parameter estimates but before model summaries.

LISREL

Using standard LISREL syntax, insert the option "EC" on the output (OU) line. The lower triangular elements of the ACOV matrix will be output to a separate file in free format in scientific notation.

Mx

...

Mplus

...

EQS

...

All material on these pages not otherwise credited is ©2003
by Kristopher J. Preacher. This page was last updated on 8/10/06.
This page was optimized to work best with Internet Explorer;
it's just plain ugly with Netscape.

Return to Table of Contents

Free JavaScripts provided
by The JavaScript Source
and John C. Pezzullo.