Chapter 13: Factor Analysis

1. Ten variables are analyzed with PCA. Assume that all of the bivariate correlations are 0.0. Theoretically, how many new components will be derived?

  1. 1
  2. 0
  3. 5
  4. 10
  5. 20

Answer: C

2. Ten variables are analyzed with PCA. Assume that all of the bivariate correlations are 1.0. Theoretically, how many new components will be derived?

  1. 1
  2. 0
  3. 5
  4. 10
  5. 20

Answer: A

3. Which of the following indicate the strength of the association between the original variables and the retained derived components?

  1. Communalities
  2. Eigenvalues
  3. Scree plots
  4. Factor loadings
  5. Varimax rotation

Answer: D

4. ______ indicate the proportion of the variance in an original variable that is explained by the retained derived components.

  1. Communalities

  2. Eigenvalues

  3. Scree plots

  4. Factor loading

  5. Varimax rotation

Answer: A

5. ______ indicate the proportion of the total variance in the original variables that is accounted for by a derived component.

  1. Communalities
  2. Eigenvalues
  3. Scree plots
  4. Factor loadings
  5. Oblique rotation

Answer: B

6. Using the “percentage of the total variance accounted for” as the criterion for evaluating a model derived using PCA, it might be argued that the model should account for at least ________.

  1. 95% of the total variance.
  2. 5% of the total variance.
  3. 10% of the total variance.
  4. 50% of the total variance.
  5. Percentage of the total variance accounted for is not used as a criterion for evaluating a model.

Answer: D

7. If we sum the communalities of all of the observed variables, divide that total by the number of observed variables, and then multiply by 100, we would know ______.

  1. The percentage of the total variance in the observed variables accounted for by the model.
  2. The percentage of the total variance in the observed variables unaccounted for by the model.
  3. The total variance in the observed variables analyzed.
  4. The total variance in the observed variables analyzed accounted for by the model.
  5. The total variance in the observed variables analyzed unaccounted for by the model.

Answer: D

8. If there are twenty original variables entered into a PCA, a derived component that accounts for 20% of the total variance in the original variables has an eigenvalue of ______.

  1. 1
  2. 20
  3. 2
  4. 5
  5. 4

Answer: E

9. If there are 16 original variables entered into a PCA, a derived component with an eigenvalue of 4.4 accounts for what percentage of the total variance in the original variables?

  1. 16%
  2. 42%
  3. 4.4%
  4. 70.4
  5. 27.5

Answer: E

10. Assume three derived components were retained following a PCA of 10 observed variables. Also assume that the components’ eigenvalues were 5.0, 2.0 and 1.5. What is the total proportion of the variance in the observed variables accounted for by the three retained components?

  1. 8.5%
  2. 15%
  3. 11.76%
  4. 85%
  5. The total proportion of the variance in the observed variables accounted for by the three retained components cannot be estimated with the information provided.

Answer: D

Short answer questions

1. Explain the “tug of war” between parsimony and completeness as it pertains to the issue of determining the number of factors to retain.
Main Points:

  1. There is a desire to account for as much of the variance in the observed variables as possible (completeness).
  2. At the same time there is a desire to keep the number of retained components as few as possible (parsimony).
  3. There is an additional dimension to this tug-of-war: comprehension. The structure needs to be comprehensible and make sense conceptually.

2. What is the difference between orthogonal and oblique rotation?
Main Points:

  1. The components derived from a Varimax rotation are kept orthogonal (uncorrelated), as are their corresponding factor scores.
  2. The components derived from an oblique rotation are allowed to correlate, as are their corresponding factor scores.
  3. In an oblique rotation the Rotated Components Matrixresulting from an orthogonal rotations is replaced by a Pattern Matrix and a Structure Matrix. The Pattern Matrix contains the new component loadings. The row for each original item is the equivalent of a regression equation where the standardized observed variable is expressed as a function of the the regression coefficients (slopes). The new loadings are in effect regression coefficients. The Structure Matrix represents the correlations between the TAI items and the oblique components.
  4. In an oblique rotation, because the two components are correlated, the regression coefficients and correlations are not identical, as they are in an orthogonal rotation ( Rotated Component Matrix). 

3. What is the driving principle of Varimax rotation?
Main Points:

  1. The goal of Varimax rotation is simple: maximize or minimize each observed variable’s loading on each component.
  2. The ultimate goal is to create a component matrix of 1.0s and 0.0s.

4. Why are the reliabilities of the individual observed variables of concern when conducting a PCA?
Main Points:

  1. The reliabilities of the individual observed variables are an important factor in determining the stability of the correlation matrix.
  2. As discussed in Chapter 7, a variable’s test-retest reliability becomes weaker, so does the possible maximum correlation with another variable. Stated otherwise, as the proportion of error variance in the measurement of a variable increases, the correlation between that variable and another variable becomes more and more random in nature, regardless of the true relation between the two variables.
  3. Unequal reliabilities results in the relative strengths of the correlations among the items becoming unstable. This can influence the pattern of factor loadings.
  4. In such circumstances there is little likelihood of replicating the results of a PCA.

5. Discuss four factors that influence the researcher’s choice of rotation and final model.
Main Points:

  1. What is expected? Do you judge the underlying theoretical constructs to be independent or related? If you deem (expect) the components to be independent, then using an oblique rotation to gain a somewhat “better fit” is inappropriate.
  2. Does previous research indicate how the components may or may not be related?
  3. What is the purpose of the analysis?
  4. The principle of a simple structure needs to be taken into account. A factor analysis has a simple structure to the extent that the loadings tend either toward 0.0 or toward 1.0.

Data set questions.

1. A social psychologist who is interested in “life satisfaction” devised a scale to estimate what she thought were three factors of importance: work, fun, and detachment (being unconcerned with most events). She also thought that there would be a difference between men and women on the various factors. Finally, she wanted to know if any of the three proposed factors were related to hopefulness, optimism, resilience, and mindfulness. To explore the topic and her scale she administered the scale to 277 students in her introductory social psychology course. Conduct a PCA on the “lifeSatisfactionScale.sav” on the textbooks web page. Is there evidence for the 3 components? The work items are labelled with “workgoal,” the fun items are labelled with “fungoal,” and the detachment items are labelled with “detach.” Evaluate both individual items (communalities) as well as the overall model. If there are three components (orthogonal or oblique), are any of them related to hopefulness, optimism, resilience, or mindfulness? What limitations do you think she would need to consider when interpreting her findings?
Main Points:
a. Testing for missing data
No variable has more than 1% missing data. There is no problem.

1

b. Running PCA using eigenvalue of 1.0 as a cut off three factors are retained with a total of 51.735% of the variance explained.
c. The three eigenvalues are 4.46, 2.053, and 1.765.
d. The rotated component matrix indicates that the three proposed subsets segregate into appropriated into the three factors (components). Factor scores were saved.

2

e. Using independent-samples t-test, no differences were found between the men and the women in terms of the fun and the detachment factor scores. There was a gender difference in term of the importance of work.
f. Correlations among the three factor scores and hopefulness, optimism, resiliency, and mindfulness.

3

Detachment factor scores (factor scores 1) are significantly (moderately to strongly) correlated with hopeful, optimism, resilient, and mindful. Work (factor scores 2) is weakly correlated with optimism and resilient. Fun factor scores (factor scores 3) are also weakly related to optimism and resilient. AMONG UNIVERSITY STUDENTS, detachment appears to be the only component of life satisfaction related to hope and mindfulness.