Abstract
Harsh parenting behaviors are some of the most commonly used discipline practices in the United States but are often difficult to measure. Self-report instruments are the most used method of assessing parenting behaviors, but likely result in response biases due to their methodological shortcomings. This study aimed to provide a viable alternative to traditional self-report surveys used to evaluate parenting practices with lower social desirability and lower literacy requirements. Our primary objectives were to adapt the Harsh Discipline Preference Discrete Choice Experiment (HDP-DCE), a picture-based measure originally developed for Liberia, for use with an American population, and evaluate its psychometric evidence of reliability and validity. We first adapted items through an iterative process of collecting feedback from 97 parents and 10 experts through focus groups and surveys to generate clear and acceptable images to elicit preferences for discipline strategies. We then administered the measure to 439 parents to explore the internal structure of the measure and evaluate multiple indicators of reliability and validity. An exploratory factor analysis resulted in three potential factor-solutions, with the three-factor solution explaining the most variance and being the most theoretically sound. Analyses also demonstrated that the HDP-DCE has excellent internal consistency, good test-retest reliability, and good convergent and discriminant validity. Given these results the HDP-DCE could be a useful alternative or complement to traditional self-report tools in research and clinical work.
Highlights
-
Adapted the Harsh Discipline Preference Discrete Choice Experiment (HDP-DCE) from Liberia to the United States, and evaluated psychometric evidence of validity and reliability of the adapted measure.
-
Exploratory factor analysis of the adapted measure supported a three-factor solution with excellent internal consistency.
-
The HDP-DCE displayed test-retest reliability and convergent and discriminant validity within the targeted population.
-
Results of this study provide evidence that the Harsh Discipline Preference Discrete Choice Experiment is a valid and reliable picture-based alternative to traditional self-report instruments.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aspland, H., & Gardner, F. (2003). Observational measures of parent-child interaction: an introductory review. Child and Adolescent Mental Health, 8(3), 136–143. https://doi.org/10.1111/1475-3588.00061.
Caruso, E. M., Rahnev, D. A., & Banaji, M. R. (2009). Using conjoint analysis to detect discrimination: revealing covert preferences from overt choices. Social Cognition, 27(1). https://doi.org/10.1521/soco.2009.27.1.128.
Caselles, C. E., & Milner, J. S. (2000). Evaluations of child transgressions, disciplinary choices, and expected child compliance in a no-cry and a crying infant condition in physically abusive and comparison mothers. Child Abuse & Neglect, 24(4), 477–491. https://doi.org/10.1016/S0145-2134(00)00115-0.
Catron, T. F., & Masters, J. C. (1993). Mothers’ and children’s conceptualizations of corporal punishment. Child Development, 64(6), 1815–1828. https://doi.org/10.2307/1131471.
Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276. https://doi.org/10.1207/s15327906mbr0102_10.
Davis, L. L. (1992). Instrument review: getting the most from a panel of experts. Applied Nursing Research, 5(4), 194–197. https://doi.org/10.1016/S0897-1897(05)80008-4.
Ferguson, C. J. (2013). Spanking, corporal punishment and negative long-term outcomes: a meta-analytic review of longitudinal studies. Clinical Psychology Review, 33(1), 196–208. https://doi.org/10.1016/j.cpr.2012.11.002.
Gamer, M., Lemon, J., & Singh, I. F. P. (2019). Irr: Various coefficients of interrater reliability and agreement (0.84.1) [Computer software]. https://CRAN.R-project.org/package=irr.
Gershoff, E. T. (2002). Corporal punishment by parents and associated child behaviors and experiences: a meta-analytic and theoretical review. Psychological Bulletin, 128(4), 539–579. https://doi.org/10.1037/0033-2909.128.4.539.
Gershoff, E. T., Goodman, G. S., Miller-Perrin, C., Holden, G. W., Jackson, Y., & Kazdin, A. E. (2019). There is still no evidence that physical punishment is effective or beneficial: reply to Larzelere, Gunnoe, Ferguson, and Roberts (2019) and Rohner and Melendez-Rhodes (2019). American Psychologist, 74(4), 503–505. https://doi.org/10.1037/amp0000474.
Green, E., Chase, R., Zayzay, J., Finnegan, A., & Puffer, E. (2017). A discrete choice task to measure preferences for harsh discipline among parents of young children. [Preprint] PsyArXiv. https://doi.org/10.31234/osf.io/egqjv.
Grusec, J. E., & Kuczynski, L. (1980). Direction of effect in socialization: a comparison of the parent’s versus the child’s behavior as determinants of disciplinary techniques. Developmental Psychology, 16(1), 1–9. https://doi.org/10.1037/0012-1649.16.1.1.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: a functional approach to concepts and methods. Psychological Assessment, 7(3), 238–247. https://doi.org/10.1037/1040-3590.7.3.238.
Kaufman, J., Jones, B., Stieglitz, E., Vitulano, L., & Mannarino, A. P. (1994). The use of multiple informants to assess children’s maltreatment experiences. Journal of Family Violence, 9(3), 227–248. https://doi.org/10.1007/BF01531949.
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012.
Krause, T., & Wahl, A. (2022). Non-compliance with indirect questioning techniques: an aggregate and individual level validation. Survey Research Methods, 16(1), https://doi.org/10.18148/srm/2022.v16i1.7824.
Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: mixing and matching contexts and perspectives. American Journal of Psychiatry, 160(9), 1566–1577. https://doi.org/10.1176/appi.ajp.160.9.1566.
Krumpal, I. (2013). Determinants of social desirability bias in sensitive surveys: a literature review. Quality & Quantity, 47(4), 2025–2047. https://doi.org/10.1007/s11135-011-9640-9.
Lansford, J. E., Chang, L., Dodge, K. A., Malone, P. S., Oburu, P., Palmérus, K., Bacchini, D., Pastorelli, C., Bombi, A. S., Zelli, A., Tapanya, S., Chaudhary, N., Deater‐Deckard, K., Manke, B., & Quinn, N. (2005). Physical discipline and children’s adjustment: cultural normativeness as a moderator. Child Development, 76(6), 1234–1246. https://doi.org/10.1111/j.1467-8624.2005.00847.x.
Lansford, J. E., Deater-Deckard, K., Dodge, K. A., Bates, J. E., & Pettit, G. S. (2004). Ethnic differences in the link between physical discipline and later adolescent externalizing behaviors. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 45(4), 801–812. https://doi.org/10.1111/j.1469-7610.2004.00273.x.
Larzelere, R. E. (2000). Child outcomes of nonabusive and customary physical punishment by parents: an updated literature review. Clinical Child and Family Psychology Review, 3(4), 199–221. https://doi.org/10.1023/A:1026473020315.
Larzelere, R. E., Gunnoe, M. L., Roberts, M. W., & Ferguson, C. J. (2017). Children and parents deserve better parental discipline research: critiquing the evidence for exclusively “positive” parenting. Marriage & Family Review, 53(1), 24–35. https://doi.org/10.1080/01494929.2016.1145613.
Larzelere, R., & Fuller, J. (2019). Scientific Evidence Supports Customary and Backup (Conditional) Spanking by Parents: Update of Larzelere and Baumrind (2010) and Fuller (2009) (SSRN Scholarly Paper No. 3500544). https://doi.org/10.2139/ssrn.3500544.
Locke, L. M., & Prinz, R. J. (2002). Measurement of parental discipline and nurturance. Clinical Psychology Review, 22(6), 895–929. https://doi.org/10.1016/S0272-7358(02)00133-2.
Lopez-Duran, N., Schneider, H., & Dula, C. (2002). Parent discipline scale: discipline choice as a function of transgression type. North American Journal of Psychology, 4, 381–393.
McCabe, K. M., Shanley, J. R., Niec, L. N., Naaf, M., Yeh, M., & Lau, A. S. (2013). Cultural differences in the parenting of young children: an observational study of low-income Mexican American and European American families. Child & Family Behavior Therapy, 35(4), 307–326. https://doi.org/10.1080/07317107.2013.846680.
Mehus, C. J., & Patrick, M. E. (2021). Prevalence of spanking in US National samples of 35-year-old parents from 1993 to 2017. JAMA Pediatrics, 175(1), 92–94. https://doi.org/10.1001/jamapediatrics.2020.2197.
Morsbach, S. K., & Prinz, R. J. (2006). Understanding and improving the validity of self-report of parenting. Clinical Child and Family Psychology Review, 9(1), 1–21. https://doi.org/10.1007/s10567-006-0001-5.
Phillips, K. A., Johnson, F. R., & Maddala, T. (2002). Measuring what people value: a comparison of “attitude” and “preference” surveys. Health Services Research, 37(6), 1659–1679. https://doi.org/10.1111/1475-6773.01116.
R Core Team. (2020). R: A language and environment for statistical computing (4.0.3) [Computer software]. R foundation for statistical computing. https://www.R-project.org.
Raiche, G., & Magis, D. (2020). nFactors: Parallel analysis and other non-graphical solutions to the Cattell Scree Test (R package version 2.4.1) [Computer software]. https://CRAN.R-project.org/package=nFactors.
Regalado, M., Sareen, H., Inkelas, M., Wissow, L. S., & Halfon, N. (2004). Parents’ discipline of young children: results from the national survey of early childhood health. Pediatrics, 113(Supplement 5), 1952–1958.
Revelle, W. (2020). psych: Procedures for personality and psychological research (R package version 2.0.12) [Computer software]. Northwestern University. https://CRAN.R-project.org/package=psych Version = 2.0.12.
Rohner, R. P., & Khaleque, A. (2005). Handbook for the study of parental acceptance and rejection. Rohner Research Publications.
Ryan, M., Gerard, K., & Amaya,M. (2008). Discrete choice experiments in a nutshell. In M. Ryan, K. Gerard, & M. Amaya (Eds.), Using Discrete Choice Experiments to Value Health and Health Care (pp. 13–46). Springer Netherlands. https://doi.org/10.1007/978-1-4020-5753-3_1.
Shelton, K. K., Frick, P. J., & Wootton, J. (1996). Assessment of parenting practices in families of elementary school-age children. Journal of Clinical Child Psychology, 25(3), 317–329. https://doi.org/10.1207/s15374424jccp2503_8.
Straus, M. A., & Field, C. J. (2003). Psychological aggression by American parents: National data on prevalence, chronicity, and severity. Journal of Marriage and Family, 65(4), 795–808. https://doi.org/10.1111/j.1741-3737.2003.00795.x.
Straus, M. A., Hamby, S. L., Finkelhor, D., Moore, D. W., & Runyan, D. (1998). Identification of child maltreatment with the parent-child conflict tactics scales: Development and psychometric data for a national sample of American parents. Child Abuse & Neglect, 22(4), 249–270. https://doi.org/10.1016/S0145-2134(97)00174-9.
Su, D., Toure, D., Do, K., & Ramos, A. K. (2019). Assessing racial and ethnic differences in attitudes towards the use of physical discipline in parenting: a mixed-methods approach. Journal of Social Service Research, 45(4), 455–465. https://doi.org/10.1080/01488376.2018.1480570.
Tisak, M. S., & Turiel, E. (1984). Children’s conceptions of moral and prudential rules. Child Development, 55(3), 1030–1039. https://doi.org/10.2307/1130154.
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response (pp. xiii, 401). Cambridge University Press. https://doi.org/10.1017/CBO9780511819322.
Tourangeau, R., & Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin, 133(5), 859–883. https://doi.org/10.1037/0033-2909.133.5.859.
UNICEF.(2022). Violent Discipline. UNICEF DATA. Retrieved Jan 25, 2023 from https://data.unicef.org/topic/child-protection/violence/violent-discipline/.
van Ommeren, M., Sharma, B., Thapa, S., Makaju, R., Prasain, D., Bhattarai, R., & Jong, J. de. (1999). Preparing instruments for transcultural research: use of the translation monitoring form with Nepali-speaking Bhutanese refugees. Transcultural Psychiatry. https://doi.org/10.1177/136346159903600304.
Funding
This study was funded by a grant from Duke Global Health Institute.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Kaitlin Quick under the supervision of Eve Puffer, Eric Green, and João Vissoci. The first draft of the manuscript was written by Kaitlin Quick with all authors commenting on- and contributing to subsequent versions. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no competing interests.
Ethics approval
This study was performed in line with the principles of the Declaration of Helsinki, with approval granted by Duke University Campus Institutional Review Board (Ethics Approval No: 2021-0016).
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Quick, K.N., Vissoci, J.R.N., Green, E.P. et al. Adaptation and Evaluation of a Picture-Based Measure of Parent Discipline. J Child Fam Stud 32, 2901–2914 (2023). https://doi.org/10.1007/s10826-023-02640-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10826-023-02640-x