Dear all,
I have tried to conduct moderation analysis in SEM by 2 different methods, i.e. creating interaction term and conducting group analysis.
However, I have obtained results which seem to lead to different conclusions.
Here are the variables that I have used:
ilo1 - ilo6: observed variables
Ilo: latent factor (and DV)
pre_post_r: categorical IV (0 or 1)
sex_r: categorical moderator (0 or 1)
By creating interaction term between pre_post_r and sex_r (sex_pp), I run the following SEM model:
Below are the results. The interaction term (sex_pp) is insignificant. So I conclude that there is no moderation effect between the IV and the moderator.
Afterwards, I run the following group analysis with another SEM model:
When testing for group invariance, the Wald test shows that the coefficient of the path pre_post_r -> Ilo is significant, indicating that the effect of IV on DV is different for the different levels of moderator (0 or 1):
Why is there such a contradictory result? Is there any constraint that I should add or release in the group analysis? Or should I use categorical IV and moderator in SEM for testing moderation?
Thank you very much.
I have tried to conduct moderation analysis in SEM by 2 different methods, i.e. creating interaction term and conducting group analysis.
However, I have obtained results which seem to lead to different conclusions.
Here are the variables that I have used:
ilo1 - ilo6: observed variables
Ilo: latent factor (and DV)
pre_post_r: categorical IV (0 or 1)
sex_r: categorical moderator (0 or 1)
By creating interaction term between pre_post_r and sex_r (sex_pp), I run the following SEM model:
Code:
sem (Ilo -> ilo1 ilo2 ilo3 ilo4 ilo5 ilo6) (pre_post_r -> Ilo) (sex_r -> Ilo) (sex_pp -> Ilo), cov(e.ilo2*e.ilo3) cov(e.ilo1*e.ilo2) cov(e.ilo1*e.ilo3)
Code:
Structural equation model Number of obs = 2,977 Estimation method: ml Log likelihood = -28216.79 ( 1) [ilo1]Ilo = 1 ----------------------------------------------------------------------------------- | OIM | Coefficient std. err. z P>|z| [95% conf. interval] ------------------+---------------------------------------------------------------- Structural | Ilo | pre_post_r | .6922629 .0669853 10.33 0.000 .5609741 .8235516 sex_r | -.6654334 .0517889 -12.85 0.000 -.7669378 -.5639291 sex_pp | .0830214 .0918951 0.90 0.366 -.0970898 .2631325 ------------------+---------------------------------------------------------------- Measurement | ilo1 | Ilo | 1 (constrained) _cons | 4.44004 .0393967 112.70 0.000 4.362824 4.517256 ----------------+---------------------------------------------------------------- ilo2 | Ilo | .7338301 .0175133 41.90 0.000 .6995047 .7681554 _cons | 4.852122 .032443 149.56 0.000 4.788535 4.915709 ----------------+---------------------------------------------------------------- ilo3 | Ilo | .8969586 .0160456 55.90 0.000 .8655098 .9284074 _cons | 4.723906 .0354097 133.41 0.000 4.654504 4.793308 ----------------+---------------------------------------------------------------- ilo4 | Ilo | 1.071829 .0188535 56.85 0.000 1.034877 1.108781 _cons | 4.508011 .0408367 110.39 0.000 4.427973 4.588049 ----------------+---------------------------------------------------------------- ilo5 | Ilo | 1.150123 .0191861 59.95 0.000 1.112519 1.187727 _cons | 4.127608 .0430686 95.84 0.000 4.043196 4.212021 ----------------+---------------------------------------------------------------- ilo6 | Ilo | 1.05216 .0180955 58.14 0.000 1.016693 1.087626 _cons | 4.348902 .0397949 109.28 0.000 4.270905 4.426899 ------------------+---------------------------------------------------------------- var(e.ilo1)| .7572459 .0229944 .7134926 .8036823 var(e.ilo2)| 1.046165 .0289415 .9909515 1.104456 var(e.ilo3)| .6229266 .0189183 .5869293 .6611316 var(e.ilo4)| .5212302 .0174359 .4881526 .5565491 var(e.ilo5)| .4115313 .015937 .3814513 .4439832 var(e.ilo6)| .4391127 .0153359 .4100605 .4702233 var(e.Ilo)| 1.242897 .0473465 1.153479 1.339246 ------------------+---------------------------------------------------------------- cov(e.ilo1,e.ilo2)| .1561735 .0188641 8.28 0.000 .1192004 .1931465 cov(e.ilo1,e.ilo3)| .113366 .0154121 7.36 0.000 .0831588 .1435731 cov(e.ilo2,e.ilo3)| .3653889 .0185338 19.71 0.000 .3290634 .4017144 ----------------------------------------------------------------------------------- LR test of model vs. saturated: chi2(21) = 223.95 Prob > chi2 = 0.0000
Code:
sem (Ilo -> ilo1 ilo2 ilo3 ilo4 ilo5 ilo6) (pre_post_r -> Ilo), group(sex_r) ginvariant(mcoef mcons serrvar) cov( e.ilo1*e.ilo2 e.ilo1*e.ilo3 e.ilo2*e.ilo3)
Code:
Structural equation model Number of obs = 2,977 Grouping variable: sex_r Number of groups = 2 Estimation method: ml Log likelihood = -26260.007 ( 1) [ilo1]0bn.sex_r#c.Ilo = 1 ( 2) [ilo2]0bn.sex_r#c.Ilo - [ilo2]1.sex_r#c.Ilo = 0 ( 3) [ilo3]0bn.sex_r#c.Ilo - [ilo3]1.sex_r#c.Ilo = 0 ( 4) [ilo4]0bn.sex_r#c.Ilo - [ilo4]1.sex_r#c.Ilo = 0 ( 5) [ilo5]0bn.sex_r#c.Ilo - [ilo5]1.sex_r#c.Ilo = 0 ( 6) [ilo6]0bn.sex_r#c.Ilo - [ilo6]1.sex_r#c.Ilo = 0 ( 7) [/]var(e.Ilo)#0bn.sex_r - [/]var(e.Ilo)#1.sex_r = 0 ( 8) [ilo1]0bn.sex_r - [ilo1]1.sex_r = 0 ( 9) [ilo2]0bn.sex_r - [ilo2]1.sex_r = 0 (10) [ilo3]0bn.sex_r - [ilo3]1.sex_r = 0 (11) [ilo4]0bn.sex_r - [ilo4]1.sex_r = 0 (12) [ilo5]0bn.sex_r - [ilo5]1.sex_r = 0 (13) [ilo6]0bn.sex_r - [ilo6]1.sex_r = 0 (14) [ilo1]1.sex_r#c.Ilo = 1 Group: Male Number of obs = 1,448 ----------------------------------------------------------------------------------- | OIM | Coefficient std. err. z P>|z| [95% conf. interval] ------------------+---------------------------------------------------------------- Structural | Ilo | pre_post_r | 1.031074 .0642268 16.05 0.000 .9051915 1.156956 ------------------+---------------------------------------------------------------- Measurement | ilo1 | Ilo | 1 (constrained) _cons | 4.102239 .0303745 135.06 0.000 4.042706 4.161772 ----------------+---------------------------------------------------------------- ilo2 | Ilo | .735468 .0174669 42.11 0.000 .7012335 .7697025 _cons | 4.59934 .0268293 171.43 0.000 4.546756 4.651925 ----------------+---------------------------------------------------------------- ilo3 | Ilo | .9008603 .0160247 56.22 0.000 .8694524 .9322681 _cons | 4.415707 .0273912 161.21 0.000 4.362021 4.469393 ----------------+---------------------------------------------------------------- ilo4 | Ilo | 1.071535 .0189074 56.67 0.000 1.034478 1.108593 _cons | 4.136944 .0307681 134.46 0.000 4.07664 4.197248 ----------------+---------------------------------------------------------------- ilo5 | Ilo | 1.150142 .0192086 59.88 0.000 1.112494 1.18779 _cons | 3.737108 .0318121 117.47 0.000 3.674757 3.799459 ----------------+---------------------------------------------------------------- ilo6 | Ilo | 1.052952 .0181181 58.12 0.000 1.017441 1.088462 _cons | 3.992495 .0296573 134.62 0.000 3.934368 4.050622 ------------------+---------------------------------------------------------------- var(e.ilo1)| .759053 .033199 .6966951 .8269924 var(e.ilo2)| 1.018051 .0406341 .9414452 1.100891 var(e.ilo3)| .5764516 .0254992 .5285792 .6286596 var(e.ilo4)| .5715825 .0268171 .5213662 .6266354 var(e.ilo5)| .4250043 .0230977 .3820614 .4727739 var(e.ilo6)| .4385163 .0218616 .3976951 .4835275 var(e.Ilo)| 1.318692 .0500662 1.224126 1.420563 ------------------+---------------------------------------------------------------- cov(e.ilo1,e.ilo2)| .1849651 .027043 6.84 0.000 .1319617 .2379684 cov(e.ilo1,e.ilo3)| .1135263 .0215603 5.27 0.000 .0712689 .1557838 cov(e.ilo2,e.ilo3)| .2892495 .0248841 11.62 0.000 .2404776 .3380215 ----------------------------------------------------------------------------------- Group: Female Number of obs = 1,529 ----------------------------------------------------------------------------------- | OIM | Coefficient std. err. z P>|z| [95% conf. interval] ------------------+---------------------------------------------------------------- Structural | Ilo | pre_post_r | .4492335 .0604778 7.43 0.000 .3306992 .5677677 ------------------+---------------------------------------------------------------- Measurement | ilo1 | Ilo | 1 (constrained) _cons | 4.102239 .0303745 135.06 0.000 4.042706 4.161772 ----------------+---------------------------------------------------------------- ilo2 | Ilo | .735468 .0174669 42.11 0.000 .7012335 .7697025 _cons | 4.59934 .0268293 171.43 0.000 4.546756 4.651925 ----------------+---------------------------------------------------------------- ilo3 | Ilo | .9008603 .0160247 56.22 0.000 .8694524 .9322681 _cons | 4.415707 .0273912 161.21 0.000 4.362021 4.469393 ----------------+---------------------------------------------------------------- ilo4 | Ilo | 1.071535 .0189074 56.67 0.000 1.034478 1.108593 _cons | 4.136944 .0307681 134.46 0.000 4.07664 4.197248 ----------------+---------------------------------------------------------------- ilo5 | Ilo | 1.150142 .0192086 59.88 0.000 1.112494 1.18779 _cons | 3.737108 .0318121 117.47 0.000 3.674757 3.799459 ----------------+---------------------------------------------------------------- ilo6 | Ilo | 1.052952 .0181181 58.12 0.000 1.017441 1.088462 _cons | 3.992495 .0296573 134.62 0.000 3.934368 4.050622 ------------------+---------------------------------------------------------------- var(e.ilo1)| .7504911 .0314915 .6912388 .8148224 var(e.ilo2)| 1.068583 .0410555 .9910704 1.152157 var(e.ilo3)| .6594714 .0275581 .6076112 .7157578 var(e.ilo4)| .4853136 .0231607 .4419777 .5328986 var(e.ilo5)| .3990046 .0214138 .3591662 .4432619 var(e.ilo6)| .4357954 .0209641 .396584 .4788836 var(e.Ilo)| 1.318692 .0500662 1.224126 1.420563 ------------------+---------------------------------------------------------------- cov(e.ilo1,e.ilo2)| .1241603 .0261024 4.76 0.000 .0730005 .1753201 cov(e.ilo1,e.ilo3)| .1067533 .0216582 4.93 0.000 .0643041 .1492026 cov(e.ilo2,e.ilo3)| .4318641 .0272252 15.86 0.000 .3785036 .4852245 ----------------------------------------------------------------------------------- LR test of model vs. saturated: chi2(34) = 422.95 Prob > chi2 = 0.0000
Code:
Tests for group invariance of parameters ----------------------------------------------------------------------------------- | Wald test Score test | chi2 df P>chi2 chi2 df P>chi2 ------------------+---------------------------------------------------------------- Structural | Ilo | pre_post_r | 54.418 1 0.0000 . . . ------------------+----------------------------------------------------------------
Thank you very much.
Comment