Docsity
Docsity

Prepare for your exams
Prepare for your exams

Study with the several resources on Docsity


Earn points to download
Earn points to download

Earn points by helping other students or get them with a premium plan


Guidelines and tips
Guidelines and tips

Multivariate Statistics: A Comprehensive Guide (PSY 614), Study notes of Psychology

An outline for a university course on multivariate statistics. It covers various topics including matrix algebra, multiple linear regression, exploratory factor analysis, and multivariate analysis of variance (manova). The document also mentions several techniques, assumptions, and applications of these statistical methods.

Typology: Study notes

2009/2010

Uploaded on 02/24/2010

koofers-user-ksj
koofers-user-ksj 🇺🇸

4

(1)

10 documents

1 / 5

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
Multivariate Design & Analysis PSY 614
T. Mark Beasley, Ph.D. Marillac Hall SB 36-E
E-Mail: beasleyt@stjohns.edu Voice:(718) 990-1478
Website: http://facpub.stjohns.edu/~beasleyt/index.html Fax: (718) 990-5926
Texts
(TF) Tabachnick, B, & Fidell, L. (2000). Using multivariate statistics (4th ed.). New York:
Allyn & Bacon.
(GSA) Green, S. B., Salkind, N. J., & Akey, T. M. (2000). Using SPSS for Windows: Analyzing
and understanding data (2nd ed.). Upper Saddle River, NJ: Prentice-Hall.
Supplementary Reading
(H) Huck, S. W. (2000). Reading Statistics and Research (3rd ed.). New York: Longman.
(MV) Mertler, C., & Vannatta, R. (2001). Advanced and multivariate statistical methods. Los
Angeles: Pyrczak Publishing. [Chapters will be available in the Reserve Room]
Other Valuable Sources:
(AF) Agresti, A., & Finlay, B. (1997). Statistical Methods for the Social Sciences (3rd ed.).
Upper Saddle River, NJ: Prentice-Hall.
COURSE OUTLINE for MULTIVARIATE STATISTICS (PSY 614)
I. Introduction to Multivariate Techniques: An Overview
A. Multivariate Research Questions vs. Multiple Univariate Research Questions
(TF1 MV1; AF10; Fish, 1988[10]; Huberty, 1994[15]; Huberty & Morris, 1989[16])
B. Overview of Techniques (TF2; MV2)
C. Canonical Correlation as the most general analytic technique
(Henson, 2000[11]; Knapp, 1978[19]; Thompson, 1991[29]).
II. Matrix Algebra (Matrix Algebra handout in Reserve Room; TF Appendix A).
A. Notation and Terminology
1. Types of Matrices; Order (dimensions) of a Matrix
a. Vectors
b. Square and Symmetric Matrices
c. Identity Matrix the matrix equivalent of 1.
d. Null Matrix the matrix equivalent of 0.
2. Matrix addition and subtraction, Matrix conformability.
Exact order must be matched.
3. Trace and Transpose of a Matrix.
4. Matrix Multiplication, Matrix conformability
a. Column of prefactor must match row of postfactor
b. Row of prefactor and column of postfactor
define the order of the product matrix.
c. A(NxK)B(KxJ) = AB(NxJ)
d. A(KxN)A(NxK) = AA(KxK) = Sum of Squares and Cross Products Matrix.
5. Inverse of a Matrix; Matrix “Division”
a. A(NxN)A-1(NxN) = A-1(NxN)A(NxN) = I(NxN), if N=1 then AA-1(NxN) = A/A = 1.
b. Not all square matrices have an inverse, they are singular.
c. Singularity one or more column(s) is a linear combination
of the other columns. This applies to rows as well.
c. Most symmetric matrices used in statistics do have an inverse.
d. Generalized inverse.
6. Eigenvalues and Determinants.
B. Univariate Procedures in Matrix Notation
pf3
pf4
pf5

Partial preview of the text

Download Multivariate Statistics: A Comprehensive Guide (PSY 614) and more Study notes Psychology in PDF only on Docsity!

Multivariate Design & Analysis PSY 614

T. Mark Beasley, Ph.D. Marillac Hall SB 36-E E-Mail: beasleyt@stjohns.edu Voice:(718) 990- Website: http://facpub.stjohns.edu/~beasleyt/index.html Fax: (718) 990-

T e x t s ( T F ) Tabachnick, B, & Fidell, L. (2000). Using multivariate statistics (4th ed.). New York: Allyn & Bacon. ( G S A ) Green, S. B., Salkind, N. J., & Akey, T. M. (2000 ). Using SPSS for Windows: Analyzing and understanding data (2nd ed.). Upper Saddle River, NJ: Prentice-Hall. S u p p l e m e n t a r y R e a d i n g ( H ) Huck, S. W. (2000). Reading Statistics and Research (3rd ed.). New York: Longman. ( M V ) Mertler, C., & Vannatta, R. (2001). Advanced and multivariate statistical methods. Los Angeles: Pyrczak Publishing. [ Chapters will be available in the Reserve Room ] Other Valuable Sources: ( A F ) Agresti, A., & Finlay, B. (1997). Statistical Methods for the Social Sciences (3rd ed.). Upper Saddle River, NJ: Prentice-Hall.

COURSE OUTLINE for MULTIVARIATE STATISTICS (PSY 614) I. Introduction to Multivariate Techniques: An Overview A. Multivariate Research Questions vs. Multiple Univariate Research Questions ( TF1 MV1; AF10; Fish, 1988 [ 1 0 ]^ ; Huberty, 1994 [ 1 5 ]^ ; Huberty & Morris, 1989 [ 1 6 ]^ ) B. Overview of Techniques ( TF2; MV2 ) C. Canonical Correlation as the most general analytic technique ( Henson, 2000 [ 1 1 ]^ ; Knapp, 1978 [ 1 9 ]^ ; Thompson, 1991 [ 2 9 ]^ ). II. Matrix Algebra ( Matrix Algebra handout in Reserve Room; TF Appendix A ). A. Notation and Terminology

  1. Types of Matrices; Order (dimensions) of a Matrix a. Vectors b. Square and Symmetric Matrices c. Identity Matrix the matrix equivalent of 1. d. Null Matrix the matrix equivalent of 0.
  2. Matrix addition and subtraction, Matrix conformability. Exact order must be matched.
  3. Trace and Transpose of a Matrix.
  4. Matrix Multiplication, Matrix conformability a. Column of prefactor must match row of postfactor b. Row of prefactor and column of postfactor define the order of the product matrix. c. A (NxK) B (KxJ) = AB (NxJ) d. A ′(KxN) A (^) (NxK) = AA (^) (KxK) = Sum of Squares and Cross Products Matrix.
  5. Inverse of a Matrix; Matrix “Division” a. A (NxN) A -1^ (NxN) = A -1^ (NxN) A (NxN) = I (NxN) , if N=1 then AA -1^ (NxN) = A/A = 1. b. Not all square matrices have an inverse, they are singular. c. Singularity one or more column(s) is a linear combination of the other columns. This applies to rows as well. c. Most symmetric matrices used in statistics do have an inverse. d. Generalized inverse.
  6. Eigenvalues and Determinants. B. Univariate Procedures in Matrix Notation

III. Multiple Linear Regression ( TF5; MV7; AF11; AF14; H19; GSA33; Cohen, 1968 [5]^ ) A. Review and Technical Issues B. Interpretation ( Huynh, 2000 [ 1 8 ]^ ; Thompson & Borello, 1985 [ 3 0 ]^ ; McNeil, 1992 [ 2 0 ]^ ; Newman, Harris, & McNeil, 1993 [ 2 1 ]^ ) C. Assumptions D. Random Effects vs. Fixed Effects Models

  1. Assumption that Y is continuous normally distributed
  2. X can be non-normal; Fixed effect models make no assumptions about the shape of X E. Regression Diagnostics F. Collinearity and Multicollinearity (Singularity). G. Nonlinear Regression, the use of exponents ( Cohen, 1978 [6]^ ) H. Product Interaction Terms. ( Cohen, 1978 [6]^ )

IV. Exploratory Factor Analysis ( TF13; MV9; AF16.3; GSA35; Comrey, 1988 [ 7 ]^ ) A. Manifest vs. Latent Variables B. Factor Analysis as a Multiple Regression Model ( Gorsuch, 1997 [36]^ ) C. Confirmatory vs. Exploratory ( Cole, 1987 [32] ; Gorsuch, 1997 [36]^ ) D. Principle Components (PCA) vs. Principal Axis Factoring or Common Factor Extraction (FA) ( Velicer & Jackson, 1990 [ 3 1 ]^ ) E. FA and the choice of elements for the diagonal

  1. Squared Multiple Correlations (Tolerance values)
  2. Reliability estimates F. Eigenvalues and Eigenvectors ( Cooper, 1983 [8] ] ; Gorsuch, 1997 [ 3 6 ]^ )

1. For PCA, trace( R ) = Σ λ = K , the number of variables. Thus, (λ / K ) and (Σ λ / K )

are proportions of common variance explained.

  1. For FA, the diagonal (prior communalities) of R is replaced with values

other than 1. Thus, [trace( R ) = Σ λ ] ≠ K , the number of variables.

G. The number of factors Decisions (Scree Plot) H. Factor Rotation

  1. Orthogonal (Varimax); Factors are uncorrelated.
  2. Oblique; Factors are not assumed (or expected) to be independent.
  3. When do inter-factors correlations suggest a collapsed factor? I. Factor Loadings and Posterior Communalities ( Cooper, 1983 [8]^ ) J. Factor Interpretation ( Floyd & Widamen, 1995 [ 3 5 ]^ ; Gorsuch, 1997 [ 3 6 ]^ ) K. Factor Scores ( Floyd & Widamen, 1995 [35] ; Gorsuch, 1997 [36]^ )
  4. PCA or FA factor scores.
  5. Sum of variables that “load” onto a factor; loss of orthogonality.
  6. Internal Consistency Reliability of Factors ( Gorsuch, 1997 [ 3 6 ]^ )

V. Statistical Models with Dichotomous Dependent Variable (Y). A. Assumption that Y is continuous normally distributed B. Linear Probability Models C. Logistic Regression ( TF12; MV11; H19; AF15; Cizek & Fitzgerald, 1999 [4]^ )

  1. Issues ; Davis & Offord, 1997 [ 3 4 ]^ )
  2. Interpretation
  3. Assumptions
  4. IRT as a logistic factor analysis D. Predictive Discriminant Analysis ( TF11; MV10; GSA34; Huberty 1984 [ 1 4 ]^ ; Huberty & Barton, 1989 [ 1 7 ]^ ) E. Predictive Discriminant Analysis vs. Logistic Regression vs. Linear Probability ( Huberty, 1972 [ 1 2 ]^ ; Fan & Wang, 1999 [ 9 ]^ )

COURSE EVALUATION

♦ Computer Homework # ♦ Multiple Regression: 4-6 pages APA Format ♦ Computer Homework # ♦ Factor Analysis: 4-6 pages APA Format ♦ Computer Homework # ♦ Mid-Term Exam ♦ Computer Homework # ♦ Logistic Regression Discriminant Analysis: 5-8 pages APA Format ♦ Computer Homework # ♦ MANOVA Discriminant Analysis: 4-6 typed pages APA Format ♦ Final Exam

GRADING CRITERIA ♦ Computer Homeworks are equally weighted and account for 25% of the Final Grade. ♦ Other Assignments are equally weighted and account for 35% of the Final Grade. ♦ The Mid-Term and Final Examinations are equally weighted and account for 40% of the Final Grade.

A 100 to 90% of Total Possible points B + 89 to 84% of Total Possible points B 83 to 77% of Total Possible points C+ 76 to 70% of Total Possible points C 69 to 63% of Total Possible points D 62 to 55% of Total Possible points

References in Reserve Room

  1. Baldwin, B. (1989). A primer in the use and interpretation of structural equation models. Measurement & Evaluation in Counseling & Development , 22 , 100-112.
  2. Beasley, T. M., & Schumacker, R. E. (1995). Multiple regression approach to analyzing contingency tables: Post-hoc and planned comparison procedures. Journal of Experimental Education , 64 , 79-93.
  3. Bird, K. D, & Hadzi-Pavlovic, D. (1983). Simultaneous test procedures and the choice of tests statistic in MANOVA. Psychological Bulletin , 105 , 302-308.
  4. Cizek, G. J., & Fitzgerald, S. M. (1999). An introduction of logistic regression. Measurement & Evaluation in Counseling & Development , 31 , 223-245.
  5. Cohen, J. (1968). Multiple regression as a general data-analytic system. P s y c h o l o g i c a l Bulletin , 70 , 426-443.
  6. Cohen, J. (1978). Partialed products a r e interactions; Partialed powers a r e curve components. Psychological Bulletin , 8 5 , 858-866.
  7. Comrey, A. L. (1988). Factor-analytic methods of scale development in personality and clinical psychology. Journal of Consulting and Clinical Psychology , 5 6 , 754-761.
  8. Cooper, J. C. B. (1983). Factor Analysis: An Overview. The American Statistician , 37 (2), 141-
  9. Fan, X., & Wang, L. (1999). Comparing linear discriminant function with logistic regression for the two-group classification problem. Journal of Experimental Education , 67 , 265-286.
  10. Fish, L. J. (1988). Why multivariate methods are usually vital_. Measurement & Evaluation in Counseling & Development_ , 21 , 130-40.
  11. Henson, R. K. (2000). Demystifying parametric analyses: Illustrating canonical correlation analyses as the multivariate general linear model. Multiple Linear Regression Viewpoints , 2 6 (1), 11-19.
  12. Huberty, C. J (1972).Regression analysis and 2-group discriminant analysis Journal of Experimental Education , 41 , 39-41.
  1. Huberty, C. J, & Smith J. D. (1982).The study of effects in MANOVA. Multivariate Behavioral Research , 17 , 417-432.
  2. Huberty, C. J (1984). Issues in the use and interpretation of discriminant analysis. Psychological Bulletin , 95 , 156-171.
  3. Huberty, C. J (1994). Why multivariable analyses? Educational and Psychological Measurement , 54 , 620-627.
  4. Huberty, C. J, & Morris, J. D. (1989). Multivariate analysis versus multiple univariate analyses. Psychological Bulletin , 1 0 5 , 302-308.
  5. Huberty, C. J, & Barton, R. M. (1989). An introduction to discriminant analysis. Measurement & Evaluation in Counseling & Development , 22 , 158-168.
  6. Huynh, C. (2000). Extraneous variables and the interpretation of regression coefficients. Multiple Linear Regression Viewpoints , 2 6 (1), 28-35.
  7. Knapp, T. R. (1978). Canonical correlation analysis: A general parametric significance- testing system. Psychological Bulletin , 8 5 , 410-416.
  8. McNeil, K. (1992). Response to Lunneborg: The conditions for interpretation of regression weights. Multiple Linear Regression Viewpoints , 1 9 (1), 37-43.
  9. Newman, I., Harris, R. J. & McNeil, K. (1993). Both Sides Now: Interpreting Beta Weights. Mid-Western Educational Researcher , 6 (1), 11-13.
  10. O’Connell, A. A. (2000). Methods for modeling ordinal outcome variables. Measurement & Evaluation in Counseling & Development , 33 , 170-193.
  11. Olson, C. L. (1976). On choosing a test statistic in multivariate analysis of variance. Psychological Bulletin , 83 , 579-586.
  12. Olson, C. L. (1979). Practical consideration in choosing a MANOVA test statistic: A rejoinder to Stevens. Psychological Bulletin , 8 6 , 1350-1352.
  13. Sheehan-Holt, J. K. (1998). MANOVA simultaneous test procedures: The power and robustness of restricted multivariate contrasts. Educational and Psychological Measurement , 58 , 861-881.
  14. Stevens, J. P. (1972). Four methods of analyzing between variation for the K-group MANOVA problem. Multivariate Behavioral Research , 7 , 499-522.
  15. Stevens, J. P. (1979). Comment on Olson: Choosing a test statistic in multivariate analysis of variance. Psychological Bulletin , 8 6 , 355-360.
  16. Stevens, J. P. (1980). Power of the multivariate analysis of variance tests. P s y c h o l o g i c a l Bulletin , 88 , 728-737.
  17. Thompson, B. (1991). A primer on the logic and use of canonical correlation analysis. Measurement & Evaluation in Counseling & Development , 24 , 80-93.
  18. Thompson, B. & Borello, G. M. (1985). The importance of structure coefficients in regression research. Educational and Psychological Measurement , 4 5 , 203-209.
  19. Velicer, W. F., & Jackson, D. N. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research , 25 , 1-28.
  20. Cole, D. A. (1987). Utility of confirmatory factor analysis in test validation research. Journal of Consulting and Clinical Psychology , 5 5 , 584-594.
  21. Crowley, S.. L., & Fan, X. (1997). Structural equation modeling: Basic concepts and applications in personality assessment. Journal of Personality Assessment , 6 8 , 508-531.
  22. Davis, L. J., & Offord, K. P. (1997). Logistic Regression. Journal of Personality Assessment , 68 , 497-507.
  23. Floyd, F. J., & Widamen, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment , 7 (3), 286-299.
  24. Gorsuch, R. L. (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment , 68 , 532-560.