https://orcid.org/0000-0002-4649-9965
Figures
Abstract
The COVID-19 pandemic has introduced novel stressors into the lives of youth. Identifying factors that protect against the onset of psychopathology in the face of these stressors is critical. We examine a wide range of factors that may protect youth from developing psychopathology during the pandemic. We assessed pandemic-related stressors, internalizing and externalizing psychopathology, and potential protective factors by combining two longitudinal samples of children and adolescents (N = 224, 7–10 and 13–15 years) assessed prior to the pandemic, during the stay-at-home orders, and six months later. We evaluated how family behaviors during the stay-at-home orders were related to changes in psychopathology during the pandemic, identified factors that moderate the association of pandemic-related stressors with psychopathology, and determined whether associations varied by age. Internalizing and externalizing psychopathology increased substantially during the pandemic. Higher exposure to pandemic-related stressors was associated with increases in internalizing and externalizing symptoms early in the pandemic and six months later. Having a structured routine, less passive screen time, lower exposure to news media about the pandemic, and to a lesser extent more time in nature and getting adequate sleep were associated with reduced psychopathology. The association between pandemic-related stressors and psychopathology was reduced for youths with limited passive screen time and was absent for children, but not adolescents, with lower news media consumption related to the pandemic. We provide insight into simple, practical steps families can take to promote resilience against mental health problems in youth during the COVID-19 pandemic and protect against psychopathology following pandemic-related stressors.
Citation: Rosen ML, Rodman AM, Kasparek SW, Mayes M, Freeman MM, Lengua LJ, et al. (2021) Promoting youth mental health during the COVID-19 pandemic: A longitudinal study. PLoS ONE 16(8): e0255294. https://doi.org/10.1371/journal.pone.0255294
Editor: Helena R. Slobodskaya, Institute of Physiology and Basic Medicine, RUSSIAN FEDERATION
Received: March 26, 2021; Accepted: July 13, 2021; Published: August 11, 2021
Copyright: © 2021 Rosen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data are available on open science framework https://osf.io/y7cmj/.
Funding: Funding/Support: This work was supported by the Bezos Family Foundation (to ANM) for collection of data. This work was also supported by the National Institute of Child Health and Human development (F32 HD089514 and K99 HD099203 to MLR) and the National Institute of Mental Health (R01 MH106482 to KAM).
Competing interests: The authors have declared that no competing interests exist.
Introduction
The COVID-19 pandemic has introduced unprecedented changes in the lives of children and adolescents. These changes brought a sudden loss of structure, routine, and sense of control. Families faced unique stressors ranging from unexpected illness, sudden unemployment and financial stressors, difficulty accessing basic necessities, and increased caretaking responsibilities paired with the shift to remote work, among others [1, 2]. Social distancing guidelines have limited youth’s contact with friends, extended family, and teachers, which may increase isolation and loneliness. Schools traditionally provide resources that may buffer youth against the negative consequences of stressors—including supportive social interactions, physical exercise, consistent meals, and a structured routine—that were unavailable to many U.S. youth for a prolonged period of time during the pandemic. These disruptions and pandemic-related stressors are likely to increase risk for depression, anxiety, and behavior problems in youth. Here, we identify factors that may protect against increases in mental health problems during the COVID-19 pandemic in a longitudinal sample assessed both prior to the pandemic and during the stay-at-home order period. We focus on simple and practical strategies that families can take in an effort to promote positive mental health outcomes in children and adolescents during the pandemic.
Exposure to stressors is strongly related to the onset of internalizing and externalizing psychopathology in children and adolescents [3–8]. The powerful association between stress and psychopathology has been replicated in longitudinal studies [7, 9, 10], including following community stressors, such as natural disasters [11, 12] and terrorist attacks [13–15]. Numerous pandemic-related experiences reflect novel stressors for youth and families, including unpredictability and daily routine disruptions [16, 17], unexpected loss of family members, friends, and loved ones [18], chronic exposure to information about threats to well-being and survival in situations that were previously safe [19], and social isolation [20]. Thus, exposure to pandemic-related stressors is likely to be associated with increases in anxiety, depression, and behavior problems in children and adolescents [1, 21, 22]. Indeed, emerging data demonstrates that youth psychopathology has increased during the COVID-19 pandemic [23].
Identifying factors that may promote youth well-being during the pandemic is a critical priority and has clear benefits for parents, pediatricians, and medical professionals. Leading theoretical models of resilience posit that factors that promote resilience exist across multiple levels including the individual, family, school, community, and broader cultural systems [24–26]. Critically, during the early period of the COVID-19 pandemic when schools were closed, stay-at-home orders were in place, and many community resources were shuttered, children were cut off from many common sources of resilience, particularly those occurring at the school and community levels. As such, home and family-level factors may have been of even greater importance than in normal circumstances. Furthermore, given the constraints faced by many families with children, we focus on a set of simple and practical strategies that are easily accessible, inexpensive, and require no specialized resources or services outside the home. We selected factors that have previously been associated with reduced child psychopathology or buffer against mental health problems following exposure to stressors, including: higher levels of physical activity [27–29]; access to nature and the outdoors [30–33]; a consistent daily routine providing structure and predictability [16, 34]; getting a sufficient amount of sleep, which is often disrupted following stressors [35–37]; and lower levels of passive screen time and news media consumption, given that higher use has been associated with elevations in child psychopathology [38], particularly following community-level stressors, like terrorist attacks [39–42].We also assessed the degree to which youth engaged in adaptive coping strategies during times of distress (e.g., exercising, seeking support from loved ones, or practicing mindfulness or meditation) [43–45]. Finally, providing help for others in need is associated with reduced anxiety and depression [46, 47]. Here, we evaluated whether these nine simple and inexpensive strategies are (a) associated with reduced psychopathology symptoms during the pandemic and (b) buffer against the negative mental health consequences of pandemic-related stressors in children and adolescents.
We examined these questions by combining two longitudinal samples of children and adolescents whose mental health was assessed prior to the COVID-19 pandemic in Seattle, Washington. This aspect of this study is critical because one of the strongest predictors of psychopathology during the pandemic is likely to be psychopathology prior to the pandemic. By controlling for pre-pandemic psychopathology, we are able to investigate changes in psychopathology that occurred during the pandemic. We then assessed pandemic-related stressors, internalizing and externalizing symptoms, and potential protective factors during six weeks between April and May of 2020—a period when the Seattle area was particularly hard-hit by the pandemic and stay-at-home orders were in place. We also followed up with participants six months later, between late November of 2020 and early January of 2021, to assess mental health. During this second follow-up, schools in the Seattle area were still operating virtually, social distancing guidelines were still in place, and new COVID-19 cases had reached a second peak. We examined whether exposure to pandemic-related stressors were associated with increases in internalizing and externalizing psychopathology, both concurrently and prospectively, controlling for pre-pandemic symptoms. We explored whether the potential protective factors were associated with changes in psychopathology during the pandemic or moderated the association of pandemic-related stressors with changes in psychopathology both during the stay-at-home orders and six months later. Finally, we tested whether these associations varied as a function of age, to determine whether the associations of potentially protective factors with psychopathology were similar for children and adolescents both concurrently and prospectively. Given the unique context of the COVID-19 pandemic, we did not have strong hypotheses about which particular protective factors would be more beneficial to children or adolescents. However, we did hypothesize that adolescents would show a stronger association between pandemic-related stress and psychopathology given previous work that shows that adolescence is a period of particular vulnerability to mental health problems following stressful life events [6, 7, 48–50].
Methods
Participants
Participants were recruited from two ongoing longitudinal studies of children and adolescents in the greater Seattle area. A sample of 224 youth aged 7–15 (Mage = 12.65, SD = 2.59, range: 7.64–15.24, 47.8% female) and a caregiver completed a battery of questionnaires to assess social behaviors and experiences and pandemic-related stressors. Participants also completed assessments of symptoms of internalizing and externalizing psychopathology. Two participants did not complete these mental health assessments and therefore were excluded from analyses. Six months later, 184 of these youth (82% of the initial pandemic sample) and a caregiver again completed an assessment of internalizing and externalizing symptoms. Ten participants did not complete these mental health assessments and therefore were excluded from analyses at T2. The racial and ethnic background of participants reflected the Seattle area, with 66% of participants identifying as White, 11% as Black, 11% as Asian, 8% as Hispanic or Latino, and 3% as another race or ethnicity.
Children from the first sample were recruited from a study of younger children (N = 99) originally recruited between January 2016 and September 2017 [51, 52]. Between March 2018 and November 2018, a subset of the original sample (N = 90) participated in a follow-up assessment of mental health. All participants who participated at baseline were contacted for the current study during the period of stay-at-home orders of the pandemic. From this sample, 68 youths (68.9% of the original sample; Mage = 8.88, range: 7.64–10.21, 53% female) and a caregiver participated in the first time point of current study (during the stay-at-home orders) and 53 completed the six-month follow-up. Mental health assessments obtained at age 6–8 years were used to control for pre-pandemic psychopathology. Three participants did not complete the most recent assessment, and mental health assessments at age 5–6 were used to control for pre-pandemic psychopathology.
Adolescent participants were drawn from a longitudinal study of children followed from early childhood to adolescence and their mothers [53]. Participants completed the most recent assessment at age 11–12 years (N = 227) between June 2017 and October 2018. These participants were re-contacted for assessment for the current study. From this sample, 154 youths (Mage = 14.3, range: 13.12–15.24, 46% female) and their caregiver completed the current study (67.8% of the most recently assessed sample) and 121 completed the six-month follow-up. Mental health assessments at age 11–12 were used to control for pre-pandemic psychopathology.
These two samples came from the same general population (youth in the Seattle area from a wide range of socioeconomic backgrounds). Critically, these two samples did not differ with regards to socioeconomic status, as measured by the income-to-needs ratio, sex distribution (ps > .8), or in exposure to pandemic-related stressors (p = .907).
Participants were excluded from the parent studies based on the following criteria: IQ < 80, active substance dependence, psychosis, presence of pervasive developmental disorders (e.g., autism), and psychotropic medication use. Across both samples, legal guardians provided informed consent and youths provided assent via electronic signature obtained using Qualtrics (Provo, UT). All study procedures were approved by the Institutional Review Board at Harvard University. Youth and their caregivers were each paid $50 for participating in the first wave of the study and $35 for the second wave.
Procedure
Parents and youth separately completed electronic surveys. Families contacted an experimenter if youth had trouble completing the surveys on their own, and an experimenter then called via phone or video chat and read the questions aloud and recorded their responses (this experimenter was blind to all data from the previous assessments). Data were collected during a six-week period between mid-April, 2020 and May 31st, 2020 (T1), during which schools were closed and stay-at-home orders were in place. A follow-up (T2) was conducted between late November 2020 and early January 2021 in which youth mental health was assessed again.
Pandemic-related stressors
We developed a set of questions to assess pandemic-related stressors (https://osf.io/drqku/; see S1 File). The assessment included health, financial, social, school, and physical environment stressors that occurred within the preceding month, based on both caregiver and child report (See Table 1). Given that the COVID-19 pandemic presented a wide range of unique stressors that have not occurred in prior community-wide disruptions, it was necessary to create a novel measure to assess these types of experiences. It is standard practice in the field to do so when novel events occur for which existing stress measures do not adequately capture the full extent of specific types of stressful experiences (e.g., to understand the unique hurricane-related stressors that occurred during Hurricane Katrina or experiences specific to the terrorist attacks on September 11th or the Oklahoma City bombing [12, 41, 54, 55].
We created a composite of pandemic-related stressors using a cumulative risk approach, [56] by determining the presence of each potential stressors (exposed versus not exposed), and creating a risk score reflecting a count of these stressors (18 maximum). Importantly, many previous studies demonstrate the utility and convergent validity of cumulative stress measures in relation to health outcomes, with a greater number of stressors predicting higher levels of mental and physical health problems [56]. Here, we provide additional evidence for convergent validity by showing that the number of stressors is moderately associated with a measure of perceived stress as measured by the Perceived Stress Scale in this sample (r = 0.399). This value is similar to the correlation between stressful life events and perceived stress observed in the original validity studies used to create the Perceived Stress Scale (r = 0.24-.35) [57].
We also assessed pandemic-related stressors at T2. Importantly we only asked about stressors occurring between T1 and T2. If, for example, a participant had family member who became ill with COVID-19 in April 2020, this would be counted in the pandemic-related stressors at T1, but not at T2. We used pandemic-related stressors at T1 in all analyses (including prospective analyses) but report on pandemic-related stressors at T2 to illustrate the ongoing nature of the pandemic during the second wave of data collection.
Potential protective factors
We assessed nine potentially protective aspects of youth and family behavior during the prior month: (a) physical activity, (b) time spent in nature, (c) time spent outdoors, (d) screen time, (e) news consumption, (f) sleep quantity, (g) family routines, (h) coping strategies, and (i) helping others (https://osf.io/drqku/, Table 1).
Internalizing and externalizing psychopathology
Psychopathology was assessed prior to the pandemic by parent and child report on the Youth Self Report (YSR) and Child Behavior Checklist (CBCL) [58, 59]. The CBCL scales are widely used measures of youth emotional and behavioral problems and use normative data to generate age-standardized estimates of internalizing and externalizing psychopathology. We used the highest T-scores from the caregiver or child on the Internalizing and Externalizing symptoms subscales as measures of pre-pandemic symptoms. The children who were 6–8 years old at the pre-pandemic time point did not complete the YSR; only the CBCL was used to compute their pre-pandemic symptoms at that time point. The use of the higher caregiver or child report for psychopathology is an implementation of the standard “or” rule used in combining caregiver and child reports of psychopathology. In this approach, if either a parent or child endorses a particular symptom it is counted with the assumption that if a symptom is reported, it is likely present. This is a standard approach in the literature on child psychopathology–for example it is how mental disorders are diagnosed in population-based studies of psychopathology in children and adolescents [60, 61].
To assess psychopathology at T1 and T2, parents and youths completed the Strengths and Difficulties Questionnaire, a widely-used assessment of youth mental health [62]. The SDQ has good reliability and validity [63, 64] and correlates strongly with the CBCL/YSR [65]. We chose to use the SDQ to reduce participant burden, as it has substantially fewer items than the CBCL/YSR. We used the highest reported value on the Internalizing and Externalizing symptoms subscales from the caregiver or child.
Family income
At T1, we asked caregivers to report their total combined family income for the 12 months prior to the onset of the pandemic in 14 bins. The median of the income bins was used except for the lowest and highest bins which were assigned $14,570 and $150,000, respectively. We then calculated the income-to-needs ratio by dividing the family’s income by the federal poverty line for a family of that size in 2020, with values less than one indicating income below the poverty line. Nine caregivers did not provide information on family income and were thus excluded from analyses. Median income-to-needs ratio was 4.19 (min = 0.35, max = 8.41).
Statistical analysis
We used linear regression to investigate the questions of interest. Continuous predictors were standardized using a z-score. Analyses were performed in R using the lme4 package and standardized coefficients are presented. Continuous age, sex, income-to-needs ratio, and pre-pandemic symptoms measured using the CBCL/YSR prior to the pandemic were included as covariates in all analyses. First, we examined the association of pandemic-related stressors with internalizing and externalizing symptoms, both concurrently and prospectively. Next, we examined the association of potential protective factors with internalizing and externalizing problems, both concurrently and prospectively. Then, we tested whether these factors moderated the association of pandemic-related stressors with psychopathology, both concurrently and prospectively. Finally, we computed interactions of each protective factor with age predicting psychopathology and the interaction of pandemic-related stressors, each potential protective factor, and age predicting psychopathology, both concurrently and prospectively. Simple slopes analysis was used to follow-up on significant interactions using the R pequod package. Stratification for simple slope analyses in analyses that used continuous moderators were conducted using a median split. In the case of age analyses, because there was a gap in age between the oldest children (10 years) and the youngest adolescents (13 years), stratifying by sample for these purposes was equivalent to stratifying by a median split. False discovery rate (FDR) correction was applied at the level of hypothesis such that we corrected for comparisons at T1 and T2 (e.g., association between physical activity and internalizing psychopathology at T1 and T2). Listwise deletion was used to handle missing data at T2, excluding participants from analysis who did not complete the second follow-up during the pandemic.
Results
Prior to the pandemic, 71 participants (31.7% of the sample) were in the subclinical or clinical range for internalizing problems and 39 participants (17.4% of the sample) were in the subclinical or clinical range for externalizing problems. Internalizing and externalizing symptoms increased substantially during the early phase of the pandemic. Specifically, 127 (56.7%) were in the subclinical or clinical range for internalizing problems and 126 (56.2%) were in the subclinical or clinical range for externalizing problems at the beginning of the pandemic.
See S1 File for the frequency of different domains of stressors at T1 and T2 (S1 Table in S1 File), the distribution of potential protective factors and psychopathology symptoms before and after the pandemic (S2 Table in S1 File), bivariate correlations between all study variables (S3 Table in S1 File) and associations between individual stressors and psychopathology at T1 and T2 (S4 Table in S1 File).
As expected, one of the strongest predictors of psychopathology during the pandemic was pre-pandemic psychopathology (see S3 Table in S1 File). Therefore, it is important to highlight that all analyses controlled for pre-pandemic psychopathology to assess changes in psychopathology specific to the pandemic period.
Pandemic-related stressors and psychopathology
The number of pandemic-related stressors was strongly associated with increases in both internalizing (β = 0.345, p < .001), and externalizing symptoms (β = 0.297, p < .001) symptoms during the pandemic, controlling for pre-pandemic symptoms (Fig 1). As expected, pre-pandemic symptoms were also strongly associated psychopathology during the pandemic in this model (β = 0.279, p < .001 and β = 0.296, p < .001 for internalizing and externalizing psychopathology, respectively).
All analyses control for age, sex, income-to-needs and pre-pandemic psychopathology symptoms.
Similarly, the number of pandemic-related stressors early in the pandemic was positively associated with internalizing (β = 0.243, p = .001) and externalizing (β = 0.288, p < .001) symptoms later in the pandemic, controlling for pre-pandemic symptoms (Fig 1). Again, pre-pandemic symptoms were strongly associated with internalizing and externalizing problems at T2 (β = 0.260, p = .001 and β = 0.278, p < .001, respectively).
The association of pandemic-related stressors with internalizing symptoms varied by age (β = 0. 0.602, p = .043), such that the association was stronger among adolescents (simple slope: b = 0.437, p < .001) than children (simple slope: b = 0.220, p = .004) concurrently. There were interactions between age and pandemic-related stressors in predicting externalizing symptoms concurrently or prospectively.
Potential protective factors
Associations of potential protective factors with concurrent psychopathology and interactions with stress and age are summarized in Table 2. Associations of potential protective factors with prospective psychopathology and interactions with stress and age are summarized in Table 3.
Significant associations are presented in BOLD and marginal associations are presented in italics.
Significant associations are presented in BOLD and marginal associations are presented in italics.
Time spent in nature and outdoors.
Greater time spent in nature was marginally associated with lower internalizing problems both concurrently and prospectively (Fig 2A and 2B), controlling for pre-pandemic symptoms. Time spent outdoors was unrelated to psychopathology. Age did not moderate any of these associations.
All analyses controlled for age, sex, income-to-needs, and pre-pandemic psychopathology symptoms.
News consumption and passive screen time.
Early in the pandemic, youths who spent less time on digital devices each day had lower externalizing symptoms (Fig 2C and 2D), controlling for pre-pandemic symptoms. Consuming <2 hours of news per day was also associated with reduced externalizing symptoms early in the pandemic (Fig 2G).
The longitudinal association between screen time and internalizing symptoms varied by age (S1 Fig in S1 File), such that children showed a positive association between screen time and internalizing psychopathology six months later (b = 0.572, p = .008), but adolescents did not (b = -0.074, p = .512).
Age moderated the association between news consumption and internalizing psychopathology prospectively. Specifically, while children showed a positive association between news consumption and internalizing psychopathology at T2 (b = 0.438, p = 0.015), adolescents showed a negative association between news consumption and internalizing psychopathology at T2 (b = -0.299, p = .015).
Screen time moderated the association of pandemic-related stressors with internalizing and externalizing psychopathology concurrently and prospectively (Fig 3). Specifically, youths who spent more time on screens showed a strong positive association of pandemic-related stressors with concurrent (b = 0.513, p < .001) and prospective (b = .335, p < .001) internalizing symptoms as well as both concurrent (b = 0.285, p < .001) and prospective (b = .383, p < .001) externalizing problems that was absent for youths who spent less time on screens at both time points (b = 0.020–0.061, p = .445-.935).
Low screen time use buffers against pandemic-related increases in internalizing and externalizing psychopathology. All analyses control for age, sex, income-to-needs ratio, and pre-pandemic psychopathology symptoms.
A three-way interaction was observed between news consumption, age, and pandemic-related stressors in predicting internalizing symptoms both concurrently and prospectively (Fig 4). Pandemic-related stressors were unrelated to internalizing problems concurrently (b = -.087, p = .502) or prospectively (b = -0.036, p = .808) among children who consumed <2 hours of news media per day, but were strongly associated with internalizing psychopathology both concurrently (b = 0.39 2, p < .001) and prospectively (b = 0.328, p = .026) among children with >2 hours daily news consumption. Among adolescents, pandemic-related stressors were strongly associated with internalizing problems concurrently (b = 0.409–0.452, p < .001), regardless of news consumption. Adolescents who consumed low levels of news during the stay-at-home orders showed a positive association between pandemic-related stressors and internalizing psychopathology six months later (b = 0.509, p = .002), while adolescents who consumed more news did not (b = 0.113, p = .346).
Low news consumption buffers children, but not adolescents, against pandemic-related increases in internalizing psychopathology concurrently (A) and prospectively (B). All analyses control for age, sex, income-to-needs ratio, and pre-pandemic psychopathology symptoms.
Sleep quantity.
Getting the recommended number of hours of sleep was unrelated to psychopathology concurrently. However, getting the recommended amount of sleep during the stay-at-home orders was marginally associated with lower levels of externalizing psychopathology six months later, controlling for pre-pandemic symptoms (Fig 2H). These associations did not vary by age.
Routine.
Youths with a more structured daily routine had lower externalizing (Fig 2E and 2F) six months later. No associations of a structured routine were found with internalizing symptoms, and no interactions with age or stress emerged.
Discussion
The present study identifies simple and practical behaviors that are associated with well-being among children and adolescents during the COVID-19 pandemic. Critically, this study involved a longitudinal sample of children and adolescents for which mental health had been assessed prior to the pandemic, during the stay-at-home orders, and six months later allowing us to investigate psychopathology during the pandemic while controlling for pre-pandemic symptoms. As expected, we found that youths who experienced greater pandemic-related stressors had higher levels of internalizing and externalizing psychopathology. Importantly, greater pandemic-related stressors during the stay-at-home orders were also prospectively associated with higher levels of both internalizing and externalizing psychopathology six months later. Critically, we identified several factors—including a structured daily routine, low passive screen time use, low news media consumption about the pandemic, and to a lesser extent spending more time spent in nature and getting the recommended amount of sleep—that are associated with better mental health outcomes in youth during the pandemic. We additionally demonstrate that the strong association between pandemic-related stressors and psychopathology is absent among children with lower amounts of screen time and news media consumption.
Youth who had a structured and predictable daily routine were less likely to experience increases in externalizing problems during the pandemic than youth with less structured routines. A sudden loss of routine has occurred for many families during the pandemic related to school closures, changes in parental work arrangements, and loss of access to activities outside the home for youth and adolescents. These disruptions in daily routine are associated with increased risk for behavior problems in youth during the pandemic, consistent with prior work suggesting that lack of predictability is strongly linked to youth psychopathology [16, 34, 66, 67]. Moreover, a recent paper during the pandemic showed that preschoolers in families that maintained a structured routine during the pandemic showed lower rates of depression and externalizing problems, over and above the effect of food insecurity, socioeconomic status, dual-parent status, maternal depression, and stress [68]. Our current findings extend this work by demonstrating that a structured routine may also be important for older children and adolescents. Although maintaining routine and structure is challenging as school closures continue and many aspects of daily life remain unpredictable, creating a structured daily routine for children and adolescents may promote better mental health during the pandemic.
Greater passive screen time use was associated with higher levels of externalizing psychopathology early in the pandemic, and greater passive screen time use was associated with higher internalizing psychopathology later in the pandemic for children but not adolescents. Additionally, the strong association of pandemic-related stressors with internalizing and externalizing psychopathology both concurrently and prospectively was reduced in children and adolescents with low passive screen time use. Previous studies have argued that the increases in screen time use over the last decade may be responsible for rising levels of anxiety and depression among children and adolescents [38]. However, others have suggested that greater screen time use may not have negative impacts [69, 70] and that psychopathology and digital device use have a reciprocal association with one another [71]. During the pandemic, youths were encouraged to use digital devices more than ever for school and social connection, which are likely to be beneficial for their development. Here, we measured passive use of digital devices, including watching videos on an electronic device, passively scrolling through social media, looking at websites and online news, and watching movies and TV—excluding more active uses of digital devices for schooling and social communication. Greater research is needed to determine whether the amount of passive screen time itself has negative effects on youth mental health or whether this association simply reflects that greater time on digital devices takes time away from other important behaviors such as exercise, sleep, or connecting with friends or family. Indeed, in the present study, screen time was inversely related with sleep quantity (S3 Table in S1 File). Therefore, one reason that youths with lower screen time use may be buffered against pandemic-related increases in psychopathology is because they are engaging in other behaviors that promote well-being such as getting sufficient sleep, among others. Together, these findings suggest some potential benefits associated with limiting passive screen time among youth during the pandemic.
Our findings also suggest that limiting news consumption about the pandemic may be beneficial, particularly for younger children. Greater news media consumption about the pandemic was associated with higher levels of externalizing problem early in the pandemic. Moreover, the strong association between pandemic-related stressors and internalizing psychopathology was absent in children who consumed lower levels of news media, although pandemic-related stressors were positively associated with internalizing symptoms in adolescents regardless of news consumption concurrently. This finding is broadly consistent with previous studies observing strong associations between media exposure about community-level stressors, including terrorist attacks and natural disasters, and higher rates of psychopathology in children and adolescents [41, 42, 72–74]. Interestingly, the same pattern persisted for children six months into the pandemic, while for adolescents who consumed more news during the stay-at-home orders showed a weaker association between stress and internalizing psychopathology six months later than those who consumed less news. Therefore, it is possible that for adolescents, having more knowledge about the pandemic early on may have been beneficial over time. Together these findings suggest that limiting certain types of news media exposure may protect against pandemic-related increases in internalizing problems, especially among young children. Importantly, this does not imply that parents should refrain from discussing the pandemic or hide the realities from their children. In fact, previous studies have found that honest conversations between parents and children provide an important protection against the development of psychopathology in the wake of natural disasters [75]. Therefore, we suggest limiting sensational news media consumption, in favor of talking to children about what is happening, listening to their concerns, and answering their questions in an age-appropriate manner.
Additionally, we found weaker and only marginally significant associations between time spent in nature and getting the recommended amount of sleep with youth psychopathology during the pandemic. We briefly discuss these findings here, as they highlight additional strategies that could be beneficial to families when considering how to support the mental health of their children during the pandemic. Greater time spent in nature was marginally associated with lower increases in internalizing symptoms relative to pre-pandemic symptoms both concurrently and prospectively. These findings are broadly consistent with prior evidence that spending at least two hours in nature per week is associated with greater well-being in adults [31] and better mental health in children [76]. Additionally, the association of stressors with well-being is reduced among children with greater access to nature [77]. Encouraging youths to spend time in nature may also be beneficial for mental health during the pandemic. In addition, children and adolescents who got the recommended amount of sleep at the beginning of the pandemic showed marginally lower levels of externalizing psychopathology six months later. These findings highlight the importance of encouraging youths to get an adequate amount sleep. Given the negative association between screen time and sleep duration both here and in prior work [78], reducing access to digital devices prior to bedtime may be one simple strategy parents can use to make it easier for their children to get an adequate amount of sleep.
Limitations
The present study has several limitations which should be acknowledged. First, we relied on self-report measures of behavior, which can be inaccurate due to recall bias. Future studies may benefit from using actigraphy to assess physical activity and sleep, geolocation to measure time spent in nature and outdoors, and direct reports of screen time use and news media consumption from digital devices for more accurate measures of potential protective factors. Second, while the longitudinal nature of the present study is a strength, it only included two snapshots of youth behavior and mental health during the pandemic. It will be important to continue to follow youths throughout the pandemic to determine factors that promote long-term risk and resilience. Third, we used a different measure of psychopathology prior to the pandemic (CBCL/YSR) than after the onset of the pandemic (SDQ). While it would have been ideal to have the same measure at all time points, the CBCL/YSR is much longer than the SDQ and we were focused on minimizing participant burden during a period of time when families were facing numerous stressors and loss of access to typical childcare options. Thus, we chose to use a shorter questionnaire that is strongly correlated with the CBCL/YSR [62, 65, 79, 80]. Relatedly, we asked questions about potential protective factors in our COVID Experiences Survey, rather than using longer validated scales for each of the factors (e.g. Pittsburgh Sleep Quality Index, Physical Activity Questionnaire for Children, Media Parenting Practices, Family Routines Inventory, German Coping Questionnaire for `Children and Adolescents, etc.). This choice was made to maximize the information gained about each family, while minimizing participant burden and thus maximizing our sample size. Fourth, we combined data from two separate samples of children (aged 7–10 and 13–15 at T1). Both samples were recruited using similar methods from the same target population, and we had identical measures of pre-pandemic psychopathology on both samples. Moreover, the samples did not differ in demographics, SES, or exposure to pandemic-related stressors. However, using two samples with a gap in age limited our ability to understand age effects across the entire spectrum of childhood and adolescence. Fifth, we demonstrate the predictive validity of the pandemic-related stress measure via moderate associations with psychopathology at both waves as well as a measure of perceived stress. However, this cumulative risk approach is limited in that it weights stressors equally that could have variable impacts. Future work should investigate whether specific stressors have been more strongly linked to changes in mental health during the pandemic (see S4 Table in S1 File for associations of specific stressors and psychopathology at T1 and T2). Finally, the present study is correlational and we are therefore limited in our ability to make causal inferences about the factors that promote well-being during the pandemic. However, given the extensive literature about the links between these factors and youth mental health, there is little reason to expect downsides to encouraging families to engage in these types of protective behaviors with their children and adolescents during the pandemic.
Conclusions and practical implications
We identify practical and easily accessible strategies that may promote greater well-being for children and adolescents during the COVID-19 pandemic. Based on these findings, we suggest that parents encourage youth to develop a structured daily routine, limit passive screen time use, limit exposure to news media—particularly for young children, and to a lesser extent spend more time in nature, and encourage youth to get the recommended amount of sleep.
Supporting information
S1 File. Please see the S1 File for frequencies of exposures to pandemic-related stressors by domain (S1 Table), distribution of potential protective factors and psychopathology symptoms (S2 Table), bivariate correlation table of all study variables (S3 Table), associations between individual stressors and psychopathology symptoms (S4 Table), age by screen time interaction predicting internalizing symptoms (S1 Fig), and the full COVID experiences surveys (caregiver and child).
https://doi.org/10.1371/journal.pone.0255294.s001
(DOCX)
Acknowledgments
The authors would also like to acknowledge Reshma Sreekala for help with data collection and Frances Li for help with compiling surveys.
References
- 1. Gruber J, Prinstein MJ, Clark LA, Rottenberg J, Abramowitz JS, Albano AM, et al. Mental health and clinical psychological science in the time of COVID-19: Challenges, opportunities, and a call to action. Am Psychol. 2020. http://doi.org/10.1037/amp0000707
- 2. Brown SM, Doom JR, Lechuga-Peña S, Watamura SE, Koppels T. Stress and parenting during the global COVID-19 pandemic. Child Abuse Negl. 2020;110(Pt 2):104699. pmid:32859394
- 3. Kessler RC, Davis CG, Kendler KS. Childhood adversity and adult psychiatric disorder in the US National Comorbidity Survey. Psychol Med. 1997;27(5):1101–19. pmid:9300515
- 4. McLaughlin KA, Green JG, Gruber MJ, Sampson NA, Zaslavsky AM, Kessler RC. Childhood adversities and first onset of psychiatric disorders in a national sample of US adolescents. Arch Gen Psychiatry. 2012;69(11):1151–60. pmid:23117636
- 5.
Hankin BL, Abela JRZ. Development of psychopathology: A vulnerability-stress perspective. Thousand Oaks: Sage; 2005.
- 6. Grant KE, Compas BE, Stuhlmacher AF, Thurm AE, McMahon SD, Halpert JA. Stressors and child and adolescent psychopathology: Moving from markers to mechanisms of risk. Psychol Bull. 2003;129(3):447–66. pmid:12784938
- 7. Grant KE, Compas BE, Thurm AE, McMahon SD, Gipson PY. Stressors and child and adolescent psychopathology: Measurement issues and prospective effects. J Clin Child Adolesc Psychol. 2004;33(2):412–25. pmid:15136206
- 8. McLaughlin KA. Future directions in childhood adversity and youth psychopathology. J Clin Child Adolesc Psychol. 2016;45(3):361–82. pmid:26849071
- 9. Jenness JL, Peverill M, King KM, Hankin BL, McLaughlin KA. Dynamic associations between stressful life events and adolescent internalizing psychopathology in a multiwave longitudinal study. J Abnorm Psychol. 2019;128(6):596–609. pmid:31368736
- 10. McLaughlin KA, Hatzenbuehler ML. Mechanisms linking stressful life events and mental health problems in a prospective, community-based sample of adolescents. J Adolesc Health. 2009;44(2):153–60. pmid:19167664
- 11. La Greca AM, Silverman WK, Vernberg EM, Prinstein MJ. Symptoms of posttraumatic stress in children after Hurricane Andrew: A prospective study. J Consult Clin Psychol. 1996;64(4):712–23. pmid:8803361
- 12. McLaughlin KA, Fairbank JA, Gruber MJ, Jones RT, Lakoma MD, Pfefferbaum B, et al. Serious emotional disturbance among youths exposed to Hurricane Katrina 2 years postdisaster. J Am Acad Child Adolesc Psychiatry. 2009;48(11):1069–78. pmid:19797983
- 13. Hoven CW, Duarte CS, Lucas CP, Wu P, Mandell DJ, Goodwin RD, et al. Psychopathology among New York City public school children 6 months after September 11. Arch Gen Psychiatry. 2005;62(5):545–52. pmid:15867108
- 14. Mullett-Hume E, Anshel D, Guevara V, Cloitre M. Cumulative trauma and posttraumatic stress disorder among children exposed to the 9/11 World Trade Center attack. Am J Orthopsychiatry. 2008;78(1):103–8. pmid:18444732
- 15. Lengua LJ, Long AC, Smith KI, Meltzoff AN. Pre-attack symptomatology and temperament as predictors of children’s responses to the September 11 terrorist attacks. J Child Psychol Psychiatry. 2005;46(6):631–45. pmid:15877768
- 16. Glynn LM, Stern HS, Howland MA, Risbrough VB, Baker DG, Nievergelt CM, et al. Measuring novel antecedents of mental illness: The Questionnaire of Unpredictability in Childhood. Neuropsychopharmacology. 2019;44(5):876–82. pmid:30470840
- 17. Chorpita BF, Barlow DH. The development of anxiety: The role of control in the early environment. Psychol Bull. 1998;124(1):3–21. pmid:9670819
- 18. Keyes KM, Pratt C, Galea S, McLaughlin KA, Koenen KC, Shear MK. The burden of loss: Unexpected death of a loved one and psychiatric disorders across the life course in a national study. Am J Psychiatry. 2014;171(8):864–71. pmid:24832609
- 19. Kendler KS, Hettema JM, Butera F, Gardner CO, Prescott CA. Life event dimensions of loss, humiliation, entrapment, and danger in the prediction of onsets of major depression and generalized anxiety. Arch Gen Psychiatry. 2003;60(8):789–96. pmid:12912762
- 20. Matthews T, Danese A, Wertz J, Ambler A, Kelly M, Diver A, et al. Social isolation and mental health at primary and secondary school entry: A longitudinal cohort study. J Am Acad Child Adolesc Psychiatry. 2015;54(3):225–32. pmid:25721188
- 21. Pfefferbaum B, North CS. Mental health and the Covid-19 pandemic. N Engl J Med. 2020;383(6):510–2. pmid:32283003
- 22. Fegert JM, Vitiello B, Plener PL, Clemens V. Challenges and burden of the Coronavirus 2019 (COVID-19) pandemic for child and adolescent mental health: A narrative review to highlight clinical and research needs in the acute phase and the long return to normality. Child Adolesc Psychiatry Ment Health. 2020;14:20. pmid:32419840
- 23. Chahal R, Kirshenbaum JS, Miller JG, Ho TC, Gotlib IH. Higher executive control network coherence buffers against puberty-related increases in internalizing symptoms during the COVID-19 pandemic. Biol Psychiatry Cogn Neurosci Neuroimaging. 2021;6(1):79–88. pmid:33097469
- 24. Masten AS. Resilience theory and research on children and families: Past, present, and promise. Journal of Family Theory and Review. 2018;10(1):12–31.
- 25. Masten AS, Motti-Stefanidi F. Multisystem resilience for children and youth in disaster: Reflections in the context of COVID-19. Advers Resil Sci. 2020;1:95–106. pmid:32838305
- 26. Masten AS. Resilience of children in disasters: A multisystem perspective. Int J Psychol. 2021;56(1):1–11. pmid:33325580
- 27. Bernstein EE, McNally RJ. Acute aerobic exercise helps overcome emotion regulation deficits. Cogn Emot. 2017;31(4):834–43. pmid:27043051
- 28. Bernstein EE, McNally RJ. Exercise as a buffer against difficulties with emotion regulation: A pathway to emotional wellbeing. Behav Res Ther. 2018;109:29–36. pmid:30081242
- 29. Schuch FB, Vancampfort D, Rosenbaum S, Richards J, Ward PB, Stubbs B. Exercise improves physical and psychological quality of life in people with depression: A meta-analysis including the evaluation of control group response. Psychiatry Res. 2016;241:47–54. pmid:27155287
- 30. Maas J, Verheij RA, de Vries S, Spreeuwenberg P, Schellevis FG, Groenewegen PP. Morbidity is related to a green living environment. J Epidemiol Community Health. 2009;63(12):967–73. pmid:19833605
- 31. White MP, Alcock I, Grellier J, Wheeler BW, Hartig T, Warber SL, et al. Spending at least 120 minutes a week in nature is associated with good health and wellbeing. Sci Rep. 2019;9:7730. pmid:31197192
- 32. Evans GW. Child development and the physical environment. Annu Rev Psychol. 2006;57:423–51. pmid:16318602
- 33. Cox DTC, Shanahan DF, Hudson HL, Fuller RA, Anderson K, Hancock S, et al. Doses of nearby nature simultaneously associated with multiple health benefits. Int J Environ Res Public Health. 2017;14(2):172. pmid:28208789
- 34. Fiese BH, Tomcho TJ, Douglas M, Josephs K, Poltrock S, Baker T. A review of 50 years of research on naturally occurring family routines and rituals: Cause for celebration? J Fam Psychol. 2002;16(4):381–90. pmid:12561283
- 35. Kim EJ, Dimsdale JE. The effect of psychosocial stress on sleep: A review of polysomnographic evidence. Behav Sleep Med. 2007;5(4):256–78. pmid:17937582
- 36.
Sadeh A, Gruber R. Stress and sleep in adolescence: A clinical-developmental perspective. In: Carskadon MA, editor. Adolescent sleep patterns: Biological, social, and psychological influences. Cambridge: Cambridge University Press; 2009. pp. 236–253.
- 37. Vidal Bustamante CM, Rodman AM, Dennison MJ, Flournoy JC, Mair P, McLaughlin KA. Within-person fluctuations in stressful life events, sleep, and anxiety and depression symptoms during adolescence: A multiwave prospective study. J Child Psychol Psychiatry. 2020;61(10):1116–25. pmid:32185808
- 38. Twenge JM, Campbell WK. Associations between screen time and lower psychological well-being among children and adolescents: Evidence from a population-based study. Prev Med Reports. 2018;12:271–83. pmid:30406005
- 39. Gold AL, Sheridan MA, Peverill M, Busso DS, Lambert HK, Alves S, et al. Childhood abuse and reduced cortical thickness in brain regions involved in emotional processing. J Child Psychol Psychiatry. 2016;57(10):1154–64. pmid:27647051
- 40. Busso DS, McLaughlin KA, Sheridan MA. Media exposure and sympathetic nervous system reactivity predict PTSD symptoms after the Boston Marathon bombings. Depress Anxiety. 2014;31(7):551–8. pmid:24995832
- 41. Pfefferbaum B, Seale TW, McDonald NB, Brandt EN, Rainwater SM, Maynard BT, et al. Posttraumatic stress two years after the Oklahoma City bombing in youths geographically distant from the explosion. Psychiatry. 2000;63(4):358–70. pmid:11218559
- 42. Fairbrother G, Stuber J, Galea S, Fleischman AR, Pfefferbaum B. Posttraumatic stress reactions in New York City children after the September 11, 2001, terrorist attacks. Ambul Pediatr. 2003;3(6):304–11. pmid:14616045
- 43. Kallapiran K, Koo S, Kirubakaran R, Hancock K. Review: Effectiveness of mindfulness in improving mental health symptoms of children and adolescents: A meta-analysis. Child Adolesc Ment Health. 2015;20(4):182–94. pmid:32680348
- 44. Wegner M, Amatriain-Fernández S, Kaulitzky A, Murillo-Rodriguez E, Machado S, Budde H. Systematic review of meta-analyses: Exercise effects on depression in children and adolescents. Front Psychiatry. 2020;11:81. pmid:32210847
- 45. Cohen S. Social relationships and health. Am Psychol. 2004;59(8):676–84. pmid:15554821
- 46. Liang J, Krause NM, Bennett JM. Social exchange and well-being: Is giving better than receiving? Psychol Aging. 2001;16(3):511–23. pmid:11554527
- 47. Doré BP, Morris RR, Burr DA, Picard RW, Ochsner KN. Helping others regulate emotion predicts increased regulation of one’s own emotions and decreased symptoms of depression. Pers Soc Psychol Bull. 2017;43(5):729–39. pmid:28903637
- 48. Espejo EP, Hammen CL, Connolly NP, Brennan PA, Najman JM, Bor W. Stress sensitization and adolescent depressive severity as a function of childhood adversity: A link to anxiety disorders. J Abnorm Child Psychol. 2007;35(2):287–299. pmid:17195949
- 49. Larson R, Ham M. Stress and “storm and stress” in early adolescence: The relationship of negative events with dysphoric affect. Dev Psychol. 1993;29(1):130–140.
- 50. Monroe SM, Rohde P, Seeley JR, Lewinsohn PM. Life events and depression in adolescence: Relationship loss as a prospective risk factor for first onset of major depressive disorder. J Abnorm Psychol. 1999;108(4):606–614. pmid:10609425
- 51. Rosen ML, Hagen MP, Lurie LA, Miles ZE, Sheridan MA, Meltzoff AN, et al. Cognitive stimulation as a mechanism linking socioeconomic status with executive function: A longitudinal investigation. Child Dev. 2020;91(4):e762–79. pmid:31591711
- 52. Rosen ML, Meltzoff AN, Sheridan MA, McLaughlin KA. Distinct aspects of the early environment contribute to associative memory, cued attention, and memory-guided attention: Implications for academic achievement. Dev Cogn Neurosci. 2019;40:100731. pmid:31766007
- 53. Lengua LJ, Moran L, Zalewski M, Ruberry E, Kiff C, Thompson S. Relations of growth in effortful control to family income, cumulative risk, and adjustment in preschool-age children. J Abnorm Child Psychol. 2015;43(4):705–20. pmid:25253079
- 54. Galea S, Ahern J, Resnick H. Psychological sequelae of the September 11 terrorist attacks in New York City. Prim Care Companion J Clin Psychiatry. 2002;346(13):982–987. pmid:11919308
- 55. Galea S, Brewin CR, Gruber M, Jones RT, King DW, King LA, et al. Exposure to hurricane-related stressors and mental illness after Hurricane Katrina. Arch Gen Psychiatry. 2007;64(12):1427–1434. pmid:18056551
- 56. Evans GW, Li D, Whipple SS. Cumulative risk and child development. Psychol Bull. 2013;139(6):1342–96. pmid:23566018
- 57. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–396. pmid:6668417
- 58. Achenbach TM, Dumenci L, Rescorla LA. DSM-oriented and empirically based approaches to constructing scales from the same item pools. J Clin Child Adolesc Psychol. 2003;32(3):328–40. pmid:12881022
- 59.
Achenbach TM. Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry; 1991.
- 60. Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, et al. Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication Adolescent Supplement. Arch Gen Psychiatry. 2012;69(4):372–380. pmid:22147808
- 61. Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in U.S. adolescents: Results from the national comorbidity survey replication-adolescent supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49(10):980–989. pmid:20855043
- 62. Goodman R. Psychometric properties of the Strengths and Difficulties Questionnaire. J Am Acad Child Adolesc Psychiatry. 2001;40(11):1337–45. pmid:11699809
- 63. Dickey WC, Blumberg SJ. Revisiting the factor structure of the Strengths and Difficulties Questionnaire: United States, 2001. J Am Acad Child Adolesc Psychiatry. 2004;43(9):1159–67. pmid:15322420
- 64. Goodman A, Lamping DL, Ploubidis GB. When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the Strengths and Difficulties Questionnaire (SDQ): Data from British parents, teachers and children. J Abnorm Child Psychol. 2010;38(8):1179–91. pmid:20623175
- 65. Goodman R, Scott S. Comparing the Strengths and Difficulties Questionnaire and the Child Behavior Checklist: Is small beautiful? J Abnorm Child Psychol. 1999;27(1):17–24. pmid:10197403
- 66. Davis EP, Stout SA, Molet J, Vegetabile B, Glynn LM, Sandman CA, et al. Exposure to unpredictable maternal sensory signals influences cognitive development across species. Proc Natl Acad Sci. 2017;114(39):10390–10395. pmid:28893979
- 67. Glynn LM, Baram TZ. The influence of unpredictable, fragmented parental signals on the developing brain. Frontiers in Neuroendocrinology. 2019;53:100736. pmid:30711600
- 68. Glynn LM, Davis EP, Luby JL, Baram TZ, Sandman CA. A predictable home environment may protect child mental health during the COVID-19 pandemic. Neurobiol Stress. 2021;14:100291. pmid:33532520
- 69. Orben A. Teenagers, screens and social media: A narrative review of reviews and key studies. Soc Psychiatry Psychiatr Epidemiol. 2020;55(4):407–14. pmid:31925481
- 70. Jensen M, George MJ, Russell MR, Odgers CL. Young adolescents’ digital technology use and mental health symptoms: Little evidence of longitudinal or daily linkages. Clin Psychol Sci. 2019;7(6):1416–33. pmid:31929951
- 71. George MJ, Russell MA, Piontak JR, Odgers CL. Concurrent and subsequent associations between daily digital technology use and high-risk adolescents’ mental health symptoms. Child Dev. 2018;89(1):78–88. pmid:28466466
- 72. Weems CF, Scott BG, Banks DM, Graham RA. Is TV traumatic for all youths? The role of preexisting posttraumatic-stress symptoms in the link between disaster coverage and stress. Psychol Sci. 2012;23(11):1293–7. pmid:23070308
- 73. fefferbaum B, Nixon SJ, Tivis RD, Doughty DE, Pynoos RS, Gurwitch RH, et al. Television exposure in children after a terrorist incident. Psychiatry. 2001;64(3):202–11. pmid:11708044
- 74. Comer JS, Kendall PC. Terrorism: The psychological impact on youth. Clin Psychol Sci Pract. 2007;14(3):179–212.
- 75. Cobham VE, McDermott B, Haslam D, Sanders MR. The role of parents, parenting and the family environment in children’s post-disaster mental health. Curr Psychiatry Rep. 2016;18(6):53. pmid:27086314
- 76. McCormick R. Does access to green space impact the mental well-being of children: A systematic review. J Pediatr Nurs. 2017;37:3–7. pmid:28882650
- 77. Wells NM, Evans GW. Nearby nature: A buffer of life stress among rural children. Environ Behav. 2003;35(3):311–30.
- 78. Twenge JM, Hisler GC, Krizan Z. Associations between screen time and sleep duration are primarily driven by portable electronic devices: evidence from a population-based study of U.S. children ages 0–17. Sleep Med. 2019;56:211–218. pmid:30639033
- 79. Van Roy B, Veenstra M, Clench-Aas J. Construct validity of the five-factor Strengths and Difficulties Questionnaire (SDQ) in pre-, early, and late adolescence. J Child Psychol Psychiatry. 2008;
- 80. Klasen H, Woerner W, Wolke D, Meyer R, Overmeyer S, Kaschnitz W, et al. Comparing the German versions of the Strengths and Difficulties Questionnaire (SDQ-Deu) and the Child Behavior Checklist. Eur Child Adolesc Psychiatry. 2000;49(12):1304–1312.
- 81. McLaughlin KA, Green JG, Alegría M, Jane Costello EJ, Gruber MJ, Sampson NA, et al. Food insecurity and mental disorders in a national sample of U.S. adolescents. J Am Acad Child Adolesc Psychiatry. 2012;51(12):1293–1303. pmid:23200286
- 82. Blumberg SJ, Bialostosky K, Hamilton WL, Briefel RR. The effectiveness of a short form of the Household Food Security Scale. Am J Public Health. 1999;89(8):1231–4. pmid:10432912
- 83. Paruthi S, Brooks LJ, D’Ambrosio C, Hall WA, Kotagal S, Lloyd RM, et al. Recommended amount of sleep for pediatric populations: A consensus statement of the American Academy of Sleep Medicine. J Clin Sleep Med. 2016;12(6):785–6. pmid:27250809