Next Article in Journal
Californians Linking Action with Science for Prevention of Breast Cancer (CLASP-BC)—Phase 2
Next Article in Special Issue
The Short-Term Impact of Animation on the Executive Function of Children Aged 4 to 7
Previous Article in Journal
A Study of the Experience of Working Adults on Regular Choral Activities: Applying Focus Groups
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 17
Issue 23
10.3390/ijerph17238861
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Network Perspective on the Relationship between Screen Time, Executive Function, and Fundamental Motor Skills among Preschoolers

by
Clarice Maria de Lucena Martins
1,
Paulo Felipe Ribeiro Bandeira
2,
Natália Batista Albuquerque Goulart Lemos
3,*,
Thaynã Alves Bezerra
1,
Cain Craig Truman Clark
4,
Jorge Mota
5 and
Michael Joseph Duncan
4
1
Department of Physical Education, Federal University of Paraiba, João Pessoa-PB 58000-000, Brazil
2
Department of Physical Education, Universidade Regional do Cariri—URCA; Crato-CE 63105-000, Brazil
3
Department of Physical Education, Federal University of Vale do São Francisco, Petrolina-PE 56304917, Brazil
4
Faculty of Health and Life Sciences, Coventry University, Priory Street, Coventry CV1 5FB, UK
5
Centre of Physical Activity, Health and Leisure, Faculty of Sport Sciences, University of Porto, 4500 Porto, Portugal
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(23), 8861; https://doi.org/10.3390/ijerph17238861
Submission received: 19 October 2020 / Revised: 20 November 2020 / Accepted: 25 November 2020 / Published: 28 November 2020
(This article belongs to the Special Issue Screen-Time and Health in Children and Adolescents)
Browse Figure
Review Reports Versions Notes

Abstract

:
The present study aimed to analyze the dynamic and nonlinear association between screen time, executive function (EF), and fundamental motor skills (FMS) in preschoolers, considering sex and body mass index (BMI) from a network perspective. Forty-two preschoolers (24 boys, 3.91 ± 0.77 years old) provided screen time, EF, FMS, and BMI data. EF was measured using the Go/No Go task, and accuracy of Go (sustain attention), reaction time of Go, and accuracy of No Go (inhibitory control) were considered. Relationships between screen time, EF, FMS, sex, and BMI were explored using a network analysis. The emerged network highlights that screen time is intensely associated with the other variables in the network, while the accuracy of Go has the greater connectivity with other nodes in the network (2.27), being the most sensitive to potential intervention changes. Moreover, sex (1.74), screen time (0.93), and accuracy of Go (0.71) showed the greatest closeness. This study showed that in the emerged network, independent of sex, screen exposure affects the accuracy on Go task, and these components affect the variables in the network, as motor abilities and tasks involved in inhibitory control.

1. Introduction

Executive function (EF) is a general term referring to complex cognitive processes needed for performing challenging goal-directed tasks, especially those that escape routine, and is composed of three core elements: inhibitory control (IC), working memory (WM), and cognitive flexibility (CF) [1,2,3]. These EF elements are based in the prefrontal cortex, and considered the basis of higher order cognitive functions, emerging with the brain and neural network, during the rapid stages of brain development [4,5]. However, studies drew attention to the impurity of EF tests in childhood, since the performance of young children in EF tasks seems to represent a confluence of cognitive processes of EF and non-EF [6,7].
Previous studies have widely assessed the IC as a measure of EF in this population, considering the preschool period has been identified as the key in its emergence [8]. Thus, EF is of extreme importance during the first years of life, as children who start school with low IC have difficulty in developing responses, and paying attention [9]. Even so, different measures of inhibition tasks, such as reaction time on accuracy, and accuracy on inhibition have been neglected. More recently, the computerized EF assessments have allowed researchers to summarize individual’s performance both on accuracy and reaction time (RT) data [10].
In the last few years, studies have given greater attention to the relationship between EF and children’s motor development, due to the close connection between brain development and motor abilities [11]. Indeed, higher-order cognitive processes and motor performance are closely linked, as they occur in the same organism, over the same period, and share the same brain basis [11,12]. Stöckel and Hughes [13] showed that in typically developing children, motor skills performance was positively related to EF. Roebers and Kauer [14] reported similar results for the association between inhibition measures and whole-body coordination in children, after controlling for age [14]. Although research has indicated the positive relationship between fundamental motor skills (FMS) and EF, environmental and behavioral factors, such as parental relationships [15], income status [16], and movement behaviors [17] as time exposed being sedentary is also related to EF, it may interfere in the association between EF and FMS. It is therefore important to consider this possibility.
Recent studies have shown that a considerable number of preschoolers worldwide are not compliant with screen time [18], and are excessively exposed to screens since the first year of life [19,20,21]. The rise of screen-based media use in preschool years may pose concerns regarding children’s neurobiological development, affecting how children play, learn, and form relationships [22,23]. A recent cross-sectional study with 3–5 year-old preschoolers showed that screen use greater than the recommended was associated with lower microstructural organization and myelination of brain white matter tracts [24]. Several cross-sectional and longitudinal studies support the notion that screen exposure may be associated with deleterious effects on children’s cognitive abilities [25,26]. Nonetheless, for preschool-aged children, the association between screen time and EF is controversial, due to the type of programming, and the social context of viewing. Moreover, preschoolers who spend excessive time in sedentary behaviors are more likely to have lower FMS scores [27].
Although often examined separately, the relationship between screen exposure, FMS, and EF in preschoolers could be better understood through the science of networks. EF is derived from complex neural connections [28,29], and is influenced by interactions with the environment. For example, with screen time. In this sense, methodologies based on complexity may be useful to understand the dynamic interaction of cognitive processes with related variables, such as FMS and screen time, allowing to assess the role of each variable within a complex, interconnected, and dynamic system. Network science, as a way of measuring complex systems, provides a topological structure of a network that can be useful to understand nonlinear relationships and is very sensitive to initial conditions. In addition, the role of each variable in the network can be better understood from the centrality measures, used to identify critical areas in the network that may be optimized though intervention processes [30]. Network science is an emerging research area used to understand and to measure complex systems. Therefore, this study aimed to analyze the dynamic and nonlinear association between compliance with screen time recommendation, EF, and FMS in preschoolers.

2. Methods

2.1. Study Description

This cross-sectional study used baseline data from the “Movement’s Cool” project, aiming to analyze the association between physical activity (PA) and health outcomes in preschoolers. All the ethical aspects were followed. The evaluation methods and procedures were approved by the Research Ethics Committee of Health Science Center (protocol n. 2,727,698), and by the Education Board of the João Pessoa, Brazil city.

2.2. Participants and Context

Preschool children, aged 3–5 years old, of both sexes, and registered in Early Education Childhood Centers (EECC) of João Pessoa/Brazil were eligible. The preschool public education zone is organized in nine districts, where the 55 EECC 3–5 years old registered students are located. Ten institutions, located in deprived areas of six different districts, agreed to participate in the study. For this study, three EECC, situated in three different districts, were randomly selected. The three preschools were located in deprived areas, with low socioeconomic status (SES): 50.5% of the mothers or fathers were unemployed, and over 71.8% of the mothers had not finished high school. The Human Development Index of the EECC areas ranges from 0.4 to 0.5. A total of 42 children completed the entire assessment protocols and composed the final sample.

2.3. Study Design

Measurements were performed over four months (August to October 2019 and March 2020). All the schools and parents were informed about the project’s protocols and procedures in meetings with the project coordinator, and agreed to participate. All children authorized by their parents were evaluated.
A prior meeting with the school’s manager was conducted during the first day at school. On the second day, the sociodemographic data and screen time were provided by parents, and the Test of Gross Motor Development—Second Edition (TGMD-2) was applied. On the third day, EF data was collected.

2.4. Variables and Protocols

2.4.1. Anthropometric Measures

Height (cm) and weight (kg) were determined using a Holtain stadiometer and digitized weighing scales (Seca 708), respectively, while the participant was lightly dressed and barefoot. BMI was calculated by dividing body weight with the squared height in meters (kg/m2).

2.4.2. Screen Time

Parents were also asked to recall the total average duration their child watched TV, used the computer, and used videogames. The questions addressed weekdays and weekend days separately and were combined for analysis (Cronbach’s α = 0.87). For screen time the questions were: “How many hours during a week day does your child usually watch TV, use computer, smartphones, or electronics games?” and “How many hours during a weekend day does your child usually watch TV, use computer, smartphones, or electronics game?”. Then, the same procedure used for sleep hours was applied. Children were then classified as compliant/noncompliant with screen time when spending: (i) ≤1 h of sedentary screen time per day, for the 3 and 4 years-old children; (ii) ≤2 h of sedentary screen time per day for the 5 years-old children [31].

2.4.3. Fundamental Motor Skills

FMS were measured using the TGMD-2 [32]. The TGMD-2 is valid and reliable for use in Brazilian children [33]. This test evaluates gross motor performance in children aged 3–10 years and consists of two factors: six locomotor skills (run, gallop, hop, leap, jump, and slide) and six ball skills (strike, bounce, catch, kick, throw, and underhand roll).
The TGMD-2 was administered at each preschool, according to the recommended guidelines [32]. Before the testing of each skill, participants were given a visual demonstration of the skill by the researcher using the correct technique but were not told what components of the skill were being assessed. Participants were then called individually to the practice trial. After that, participants performed the skill twice. General encouragement, but no verbal feedback on performance was given during or after the tests. All skills were video-recorded and later assessed by one trained assessor who had not administered the tests. The time taken to assess each child was approximately 40 min.
Using the media player classic software, the videos were analyzed to evaluate skills’ criteria. Two Professors in the motor behavior field, with experience in assessing the TGMD-2, carried out a training process on the protocol’s criteria with a master student who did not participate in data assessment. The training process was carried out over 2 weeks and 10% of the videos were randomly analyzed twice by the evaluator, with an interval of 10 days between each evaluation, to determine the intraclass correlation coefficient (ICC). A high agreement for the locomotion score: ICC = 0.93 (95% CI: 0.69–0.98), for the object control score: ICC = 0.98 (95% CI: 0.93–0.99) and for total motor score (MS): ICC: 0.96; (95% CI: 0.82–0.99) were observed. The locomotion and object control scores were based on the presence (one) or absence (zero) of each of the performance criteria. For each subtest, the sum of the raw scores varied from 0 to 48 points.

2.4.4. Executive Function

EF was assessed using Early Years Toolbox—EYT. The “EYT” is a battery of computerized tasks that was developed to assess the EF of children aged 3–5 years-old [34]. The battery consists of five tasks assessed from games in an app designed for iPad. In preschoolers’ immature-brains, IC, working memory, and cognitive flexibility share common processes being challenging to disassociate [3]. Additionally, it is relevant to consider that in early childhood, these components are strongly related to inhibition, both at the representational level or to the maintenance of objectives [35,36,37]. Thus, EF was measured using the Fish and Shark, a typically Go/No Go task. Children were instructed to tap the screen whenever they saw a fish (Go) and not tap the screen when a shark appeared (No Go). Therefore, children must hold their attention and focus on the task but also must inhibit motor responses to the target stimulus [38]. Each stimulus trial remained on the screen for 1500ms, followed by inter stimulus interval of 1000ms. Children completed three blocks of 25 trials (a total of 75 test trials), with 80% Go trials (60 fishes) and 20% No Go trials (15 sharks) that were presented in randomized order. Before beginning the test, each child had the opportunity to hear the app instruction, and to do a full task practice for familiarity. Accuracy of Go, a measure of sustained attention; accuracy of No Go, which is related to inhibition processes; RT of Go, related to speed of response selection were considered, and RT for incorrect responses was set to missing. Previous studies have shown that the Go/No Go tests can activate the entire prefrontal cortex (the brain region considered the basis of support for EF), and it is a more robust task than others to establish EF performance [37,39]. For analysis, one point was assigned for each correct answer, with the score ranging from 0 to 60 points for Go and 0 to 15 points for No Go. This protocol presents satisfactory reliability values with Cronbach’s α = 0.95 [34]. In the current study, the composite reliability value for Go/No Go was 0.78, which is considered an adequate value.

2.5. Statistical Procedures

Variables were checked for normality using Kolmogorov–Smirnov tests, and described as categorical or continuous or variables. Chi-squared test was used to calculate the association between proportion of screen time guideline adherence and sex, and Cohen’s d was used to assess effect size among continuous variables [40], defined as small (≥0.2), medium (≥0.5), and large (≥0.8). Statistical significance was accepted, a priori, at p < 0.05, and all data were analyzed using SPSS Windows v 20.0 (SPSS, Inc., Chicago, IL, USA).
A network analysis was used to assess the association between adherence to screen time guidelines, FMS, and EF trials, considering children’s age, sex, and BMI. The betweenness, closeness, and strength centrality indicators were reported. Variables with higher betweenness values are more sensitive to changes and may act as a hub, connecting other pairs of variables in the network. A variable with a high closeness value will be quickly affected by changes in any part of the network and may also affect other parts. The strength indicator is essential to understand which variables present the most robust connections in the current network pattern.
The “Fruchterman–Reingold” algorithm was applied. Data were shown in the relative space in which variables with stronger permanent association remain together and with less strongly applied variations repelled one another [41]. To improve the accuracy of the network we used the model “random fields of pair wise Markov”. The algorithm adds a “L1” (regularized neighborhood regression) penalty. The regulation is estimated by a less complete selection and contraction operator (Lasso) that controls the sparse network. The extended Bayesian information criterion (EBIC) to select the Lambda of the regularization parameter was observed. EBIC uses a hyperparameter (y) that determines how much EBIC selects sparse models [42,43]. The y value was determined at 0.25 (range from 0 to 0.50), which is a more parsimonious value in exploratory networks, as proposed in the current study. The network analysis uses least absolute shrinkage and selection operator (LASSO) regularized algorithms to get the precision matrix (weight matrix). When standardized, this matrix represents the associations between the variables in the network. The network is presented in a graph that includes the variables (nodes) and the relations (lines). The full lines represent positive associations and the dashed lines represent negative ones. The thickness and intensity of the lines represent the magnitude of the associations. The qgraph package of RStudio [44] was used to plot the aforementioned figures.

3. Results

For screen time, the majority of boys and girls did not comply with WHO recommendations and had similar proportions (x2 = 1.87; p = 0.172). The boys showed better performance in locomotion, object control, accuracy on Go trial, and reaction time and the girls performed better on accuracy No Go. The effect size was large for all comparisons (Cohen’s d > 0.50), except for BMI (Table 1).
The current network standard (Figure 1; Table 2) indicates that compliance with the screen time recommendation is related to the decrease in BMI (−0.52), with accuracy of Go (0.33), decrease in No Go accuracy (−0.26) and also with the improvement of object control skills (0.14). As children get older, there is better compliance with screen time guidelines (0.25) and better accuracy of Go and No Go (0.09 and 0,44, respectively).
Screen time and sex showed the highest strength values, 0.939 and 1.354, respectively, these variables showed the strongest relationships in the network. The variables Ac-Go (2.275), and sex (0.659) presented the highest values of betweenness and the variables Ac-Go (0.714), sex (1.740), and screen time (0.928) have a higher closeness value (Table 3).

4. Discussion

This study aimed to assess the associations between compliance with screen time recommendation, EF, and FMS in preschoolers. Although these association have been commonly examined separately, cognition and motor aspects share the same brain basis [11,45] and are affected by screen time. It therefore makes sense to examine these constructs together. Thus, this study adds important information to the literature, accounting for the nonlinear, dynamic, and complex relationship between screen time, EF, and FMS in young children.
The current results showed low compliance with screen time recommendation (less than 10%). This is lower than the percentage observed for preschoolers from Canada (24.4%), Australia (17.3%), Belgium (61%), and Portugal (20.3%), while no differences between sexes has been seen [19,20,21,46]. Possible contextual reasons for screen time patterns has been reported, such as sociodemographic status, single child or siblings, parent’s marital status, parents’ level of awareness regarding the impact of screen time in children’s healthy, and maternal behavioral factors (include age, educational level, pre-pregnancy behaviors, and emotional regulation) [47,48]. These findings highlight the importance of promoting information about screen time guidelines to parents of preschool children.
Several computational measures have been proposed to assess the EF in childhood, based mainly on general accuracy scores. General accuracy of Go/No Go task represents the proportion of correct responses in frequent stimulus and less frequent stimulus [49]. In the present study, the accuracy was computed separately for Go and No-Go trials, and mean RT were calculated for correct Go trials. This analysis allows a more detailed view of the results, once the performance in these variables differ according to age [50,51]. Wiebe et al. [51] showed that young children responded more quickly and accurately on Go trials, but had greater difficulty in inhibiting responding on No-Go trials. Indeed, both RT and accuracy have shown progressive improvement throughout preschool years. In addition, the developmental trajectory of RT, as well as the capacity for attention and inhibition, occurs in different ways throughout early childhood [8,52,53].
The results of the current study also highlighted that girls were more accurate than boys on No-Go trials, reflecting their better inhibition response. Gender differences in emotion expressions, and sensitivity to feedback contribute to differences in inhibitory capacity between sexes [54,55,56]. For example, different neurophysiological responses to negative feedback have been demonstrated, where girls showed more chances of frequent losses and errors, compared to boys [54]. Thus, we may hypothesize that girls’ strategies emphasize avoiding errors commission (No-Go).
It was also observed that boys performed better in both locomotor and object control skills than girls. This is not surprising as several studies reported that boys better performed total FMS scores, especially on object control skills [57,58]. Nonetheless, both boys and girls should permanently be encouraged to be physically active. Additionally, sex and compliance with screen time recommendations showed the highest strength in the network, highlighting that compliance with screen time is strongly connected with other nodes (age, Ac-Go, and object control score) in the emerged network pattern. As children tend to master in locomotion skills earlier than in object control ones, the variability observed for object control skills may explain its significant results observed, in detriment of locomotion skills.
The current study also showed that the accuracy of Go, which represents the ability to sustain attention, showed the highest betweenness in the network. This centrality measure indicates that accuracy of Go has the greater connectivity with other nodes in the network, being the most sensitive to potential intervention changes. Indeed, children with greater skills for sustained attention exhibited greater IC, showing a close relationship between the development of attention capacity and improvements in EF during childhood [55,59,60]. Garon et al. [8] have previously reported that maturing attention span forms a basis for the development of EF skills during preschool and, in fact, can be a common source of variation underlying several EF skills.
Moreover, sex, compliance with screen time recommendations, and accuracy of Go showed the greatest closeness. These variables are responsible for spreading the effect of interventions more quickly on all other variables present in the network. Improving FMS, maintaining or improving BMI, and improving RT in children initially depends on improving screen time (namely compliance with guidelines recommendation), and accuracy of Go. As no difference in compliance with screen time has been seen between boys and girls, the strength of this variable in the network is related to similar opportunities for boys and girls.
It is also important to mention that environmental factors, such as screen time, could negatively influence both the performance in FMS and in EF tasks in early childhood [27,61,62]. The low amount of time children are engaged in physical practice enables motor experiences [63]. Additionally, previous studies have demonstrated the relationship between screen time with worse inattention, self-regulation problems, and emotional disorders [64,65]. Furthermore, Sigman [61] report that dopamine, a hormone related to the ability to pay attention, is produced in response to screen novelty, and excessive screen time may lead to long-term changes in the reward circuitry that resemble the effects of substance dependence. Moreover, the critical role of dopamine in both motor and cognitive functions [11] provide reasons why these variables should be considered indissociably. Nonetheless, the impact of screen exposure on EF in preschoolers is controversial. Indeed, screen time may be either passive or active [66]. Passive screen time refers to the viewing of screen content that requires little or no interaction from the user, as in television viewing, which has been associated to language and cognitive impairment in young children [67,68,69]. Although the type of screen time has not been reported, in the current study, the assessed children spend a great amount of time in passive screen time, as television viewing is cultural in the Brazilian context, and many families have no access to internet, similar to other Latino countries [70,71]. Moreover, the variety of EF tests used in the studies makes it difficult to extrapolate results. For example, several studies have used measures involving multiple aspects of EF as self-regulation, which makes it difficult to investigate specific components of EF and screen time exposure [47,72,73]. In the present study, the EF was assessed using a Go/No Go test, which allows to obtain data regarding the performance of attention, processing speed, and IC of children.
Accuracy of Go, sex, and compliance with screen time recommendations showed greater closeness in the network. Evidence suggests that, regardless of gender, few preschoolers meet the recommendations of screen time [19,46]. However, there seems to be a consensus regarding the implementation of strategies aimed at promoting children’s compliance with screen time recommendations, in order to positively influence children’s cognitive health [19,74]. Thus, from the findings of the present study, it can be speculated that the change in the screen time may influence the attention capacity of children, which, indirectly, will have reflections on other components such as RT and inhibitory capacity.
In addition, recent findings demonstrate that children with lower screen time demonstrated better EF, and children who engaged in more PA demonstrated better gross motor skills [75]. In this sense, strategies to reduce screen time and promote activities, especially those that enhance mastery in motor skills, are important for a child’s daily life. From this perspective, the inclusion of adequate and planned physical activities for the age group can contribute not only to motor gain, but also cognitive, since interesting tasks for the child become an object of attention [55].
The strengths of this study include the computerized Go/No Go assessment task that improves the standardization and sensitivity of EF performance; as far as we know, this is the first study to report the relationship between compliance with screen time recommendations, EF, and FMS in preschoolers through a network perspective. However, some limitations should be highlighted. The lack of information regarding the type of screen time (passive or active), the content of the screen offered to the children (educational or entertainment media), as well as the parent-reported screen time are notable limitations. However, it is also worth mentioning that there is no objective validated method of assessing screen time in preschool-aged children. Moreover, the assessed children spend 10 h per day in preschool settings, where electronic devices are forbidden, and screen time is restricted to home time, likely under parent supervision.
Further, the present study comprises a specific low-income sample. It is known that children from low-income families, and living in socially vulnerable environments [16,76], are more likely to display reduced cognition. Accordingly, the present results should not be extrapolated to the general population. Nonetheless, this study provides novel insight for a specific-targeting population that could benefit from the current evidence. Additionally, information concerning parents’ behaviors, especially the maternal data, and children’s time spent on different types of structured and unstructured PA should be included in future studies.
Thus, the present study shows that in the emerged network, independent of sex, the compliance with screen time recommendation affects the accuracy on the Go task, in preschoolers. The relationship between these components affects other variables present in the network, such as motor abilities and tasks involved in inhibitory control. Future studies should focus on interventions that reduce screen exposure in younger children.

Author Contributions

Conceptualization, C.M.d.L.M., N.B.A.G.L., T.A.B., J.M. and M.J.D.; Methodology: C.M.d.L.M., P.F.R.B., N.B.A.G.L., T.A.B. and C.C.T.C.; Formal analysis: P.F.R.B.; Investigation: C.M.d.L.M.; Resources: C.M.d.L.M.; Data Curation: C.M.d.L.M. and P.F.R.B.; Writing Original Draft Preparation: C.M.d.L.M., N.B.A.G.L., T.A.B., P.F.R.B., C.C.T.C., J.M. and M.D.; Writing—Review & Editing: C.M.d.L.M., J.M. and M.D.; Supervision: C.M.d.L.M., J.M. and M.D.; Project administration: C.M.d.L.M. All authors have read and agreed to the published version of the manuscript.

Funding

Clarice Martins was supported by Brazilian Federal Foundation for Support and Evaluation of Graduate Education-CAPES (CAPES-PRINT-88887.369625/2019-00).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wu, M.; Liang, X.; Lu, S.; Wang, Z. Infant motor and cognitive abilities and subsequent executive function. Infant Behav. Dev. 2017, 49, 204–213. [Google Scholar] [CrossRef]
  2. Bell, M.A.; Cuevas, K. Psychobiology of executive function in early development. In Executive Function in Preschool-Age Children: Integrating Measurement, Neurodevelopment, and Translational Research; American Psychological Association: Washington, DC, USA, 2015; pp. 157–179. [Google Scholar] [CrossRef]
  3. Diamond, A. Executive Functions. Annu. Rev. Psychol. 2013, 64, 135–168. [Google Scholar] [CrossRef] [Green Version]
  4. Fuster, J.M. The Prefrontal Cortex, 5th ed.; Academic Press: London, UK, 2015. [Google Scholar]
  5. Cao, M.; Huang, H.; He, Y. Developmental Connectomics from Infancy through Early Childhood. Trends Neurosci. 2017, 40, 494–506. [Google Scholar] [CrossRef]
  6. Willoughby, M.T.; Blair, C.B.; Kuhn, L.J.; Magnus, B.E. The benefits of adding a brief measure of simple reaction time to the assessment of executive function skills in early childhood. J. Exp. Child Psychol. 2018, 170, 30–44. [Google Scholar] [CrossRef]
  7. Willoughby, M.; Hong, Y.; Hudson, K.; Wylie, A. Between- and within-person contributions of simple reaction time to executive function skills in early childhood. J. Exp. Child Psychol. 2020, 192, 104779. [Google Scholar] [CrossRef]
  8. Garon, N.; Bryson, S.E.; Smith, I.M. Executive function in preschoolers: A review using an integrative framework. Psychol. Bull. 2008, 134, 31–60. [Google Scholar] [CrossRef] [Green Version]
  9. Diamond, A. Why improving and assessing executive functions early in life is critical. In Executive Function in Preschool-Age Children: Integrating Measurement, Neurodevelopment, and Translational Research; American Psychological Association (APA): Washington, DC, USA, 2016; pp. 11–43. [Google Scholar]
  10. Camerota, M.; Willoughby, M.T.; Magnus, B.E.; Blair, C.B. Leveraging item accuracy and reaction time to improve measurement of child executive function ability. Psychol. Assess. 2020. [Google Scholar] [CrossRef]
  11. Diamond, A. Close Interrelation of Motor Development and Cognitive Development and of the Cerebellum and Prefrontal Cortex. Child Dev. 2000, 71, 44–56. [Google Scholar] [CrossRef]
  12. Rigoli, D.; Piek, J.P.; Kane, R.; Oosterlaan, J. An examination of the relationship between motor coordination and executive functions in adolescents. Dev. Med. Child Neurol. 2012, 54, 1025–1031. [Google Scholar] [CrossRef] [Green Version]
  13. Stöckel, T.; Hughes, C.M.L. The relation between measures of cognitive and motor functioning in 5- to 6-year-old children. Psychol. Res. 2016, 80, 543–554. [Google Scholar] [CrossRef]
  14. Roebers, C.M.; Kauer, M. Motor and cognitive control in a normative sample of 7-year-olds. Dev. Sci. 2009, 12, 175–181. [Google Scholar] [CrossRef]
  15. Walker, A.K.; MacPhee, D. How home gets to school: Parental control strategies predict children’s school readiness. Early Child. Res. Q. 2011, 26, 355–364. [Google Scholar] [CrossRef]
  16. Lawson, G.M.; Hook, C.J.; Farah, M.J. A meta-analysis of the relationship between socioeconomic status and executive function performance among children. Dev. Sci. 2018, 21, e12529. [Google Scholar] [CrossRef]
  17. Tandon, P.S.; Klein, M.; Saelens, B.E.; Christakis, D.A.; Marchese, A.J.; Lengua, L. Short term impact of physical activity vs. sedentary behavior on preschoolers’ cognitive functions. Ment. Health Phys. Act. 2018, 15, 17–21. [Google Scholar] [CrossRef]
  18. Willumsen, J.; Bull, F. Development of WHO Guidelines on Physical Activity, Sedentary Behavior, and Sleep for Children Less Than 5 Years of Age. J. Phys. Act. Health 2020, 17, 96–100. [Google Scholar] [CrossRef] [Green Version]
  19. Chaput, J.P.; Colley, R.C.; Aubert, S.; Carson, V.; Janssen, I.; Roberts, K.C.; Tremblay, M.S. Proportion of preschool-aged children meeting the Canadian 24-Hour Movement Guidelines and associations with adiposity: Results from the Canadian Health Measures Survey. BMC Public Health 2017, 17, 829. [Google Scholar] [CrossRef] [Green Version]
  20. Cliff, D.P.; McNeill, J.; Vella, S.A.; Howard, S.J.; Santos, R.; Batterham, M.; Melhuish, E.; Okely, A.D.; De Rosnay, M. Adherence to 24-Hour Movement Guidelines for the Early Years and associations with social-cognitive development among Australian preschool children. BMC Public Health 2017, 17, 207–215. [Google Scholar] [CrossRef] [Green Version]
  21. De Craemer, M.; McGregor, D.; Androutsos, O.; Manios, Y.; Cardon, G. Compliance with 24-h movement behaviour guidelines among belgian pre-school children: The toybox-study. Int. J. Environ. Res. Public Health 2018, 15, 2171. [Google Scholar] [CrossRef] [Green Version]
  22. Horowitz-Kraus, T.; Hutton, J.S. Brain connectivity in children is increased by the time they spend reading books and decreased by the length of exposure to screen-based media. Acta Paediatr. 2018, 107, 685–693. [Google Scholar] [CrossRef]
  23. Paulus, M.P.; Squeglia, L.M.; Bagot, K.; Jacobus, J.; Kuplicki, R.; Breslin, F.J.; Bodurka, J.; Morris, A.S.; Thompson, W.K.; Bartsch, H.; et al. Screen media activity and brain structure in youth: Evidence for diverse structural correlation networks from the ABCD study. Neuroimage 2019, 185, 140–153. [Google Scholar] [CrossRef]
  24. Hutton, J.S.; Dudley, J.; Horowitz-Kraus, T.; Dewitt, T.; Holland, S.K. Associations between Screen-Based Media Use and Brain White Matter Integrity in Preschool-Aged Children. JAMA Pediatr. 2020, 174, e193869. [Google Scholar] [CrossRef] [Green Version]
  25. Christakis, D.A.; Zimmerman, F.J.; DiGiuseppe, D.L.; McCarty, C.A. Early Television Exposure and Subsequent Attentional Problems in Children. Pediatrics 2004, 113, 708–713. [Google Scholar] [CrossRef] [Green Version]
  26. Johnson, J.G.; Cohen, P.; Kasen, S.; Brook, J.S. Extensive television viewing and the development of attention and learning difficulties during adolescence. Arch. Pediatr. Adolesc. Med. 2007, 161, 480–486. [Google Scholar] [CrossRef] [Green Version]
  27. Webster, E.K.; Martin, C.K.; Staiano, A.E. Fundamental motor skills, screen-time, and physical activity in preschoolers. J. Sport Health Sci. 2019, 8, 114–121. [Google Scholar] [CrossRef]
  28. Petrella, J.R. Use of Graph Theory to Evaluate Brain Networks: A Clinical Tool for a Small World? Radiology 2011, 259, 317–320. [Google Scholar] [CrossRef]
  29. Telesford, Q.K.; Simpson, S.L.; Burdette, J.H.; Hayasaka, S.; Laurienti, P.J. The Brain as a Complex System: Using Network Science as a Tool for Understanding the Brain. Brain Connect. 2011, 1, 295–308. [Google Scholar] [CrossRef] [Green Version]
  30. Hevey, D. Network analysis: A brief overview and tutorial. Heal. Psychol. Behav. Med. 2018, 6, 301–328. [Google Scholar] [CrossRef] [Green Version]
  31. Tremblay, M.S.; Carson, V.; Chaput, J.P.; Connor Gorber, S.; Dinh, T.; Duggan, M.; Faulkner, G.; Gray, C.E.; Grube, R.; Janson, K.; et al. Canadian 24-h movement guidelines for children and youth: An integration of physical activity, sedentary behaviour, and sleep. Appl. Physiol. Nutr. Metab. 2016, 41, S311–S327. [Google Scholar] [CrossRef]
  32. Ulrich, D. TGMD 2-Test of Gross Motor Development Examiner’s Manual; PRO-ED: Austin, TX, USA, 2000. [Google Scholar]
  33. Valentini, N.C. Validity and reliability of the TGMD-2 for Brazilian children. J. Mot. Behav. 2012, 44, 275–280. [Google Scholar] [CrossRef]
  34. Howard, S.J.; Melhuish, E. An Early Years Toolbox for Assessing Early Executive Function, Language, Self-Regulation, and Social Development: Validity, Reliability, and Preliminary Norms. J. Psychoeduc. Assess. 2017, 35, 255–275. [Google Scholar] [CrossRef]
  35. Karr, J.E.; Areshenkoff, C.N.; Rast, P.; Hofer, S.M.; Iverson, G.L.; Garcia-Barrera, M.A. The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychol. Bull. 2018, 144, 1147–1185. [Google Scholar] [CrossRef] [PubMed]
  36. Miyake, A.; Friedman, N.P.; Emerson, M.J.; Witzki, A.H.; Howerter, A.; Wager, T.D. The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis. Cogn. Psychol. 2000, 41, 49–100. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Willoughby, M.T.; Blair, C.B.; Wirth, R.J.; Greenberg, M. The measurement of executive function at age 5: Psychometric properties and relationship to academic achievement. Psychol. Assess. 2012, 24, 226–239. [Google Scholar] [CrossRef] [PubMed]
  38. St. John, A.M.; Finch, K.; Tarullo, A.R. Socioeconomic status and neural processing of a go/no-go task in preschoolers: An assessment of the P3b. Dev. Cogn. Neurosci. 2019, 38, 100677. [Google Scholar] [CrossRef] [PubMed]
  39. Smith, E.; Anderson, A.; Thurm, A.; Shaw, P.; Maeda, M.; Chowdhry, F.; Chernomordik, V.; Gandjbakhche, A. Prefrontal Activation During Executive Tasks Emerges Over Early Childhood: Evidence From Functional Near Infrared Spectroscopy. Dev. Neuropsychol. 2017, 42, 253–264. [Google Scholar] [CrossRef] [PubMed]
  40. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2rd ed.; Lawrence Erlbaum Associates: New York, NY, USA, 2013. [Google Scholar]
  41. Fruchterman, T.M.J.; Reingold, E.M. Graph drawing by force-directed placement. Softw. Pract. Exp. 1991, 21, 1129–1164. [Google Scholar] [CrossRef]
  42. Chen, J.; Chen, Z. Extended Bayesian information criteria for model selection with large model spaces. Biometrika 2008, 95, 759–771. [Google Scholar] [CrossRef] [Green Version]
  43. Foygel, R.; Drton, M. Extended Bayesian Information Criteria for Gaussian Graphical Models. In Advances in Neural Information Processing Systems 23 (NIPS 2010), Proceedings of 24th Annual Conference on Neural Information Processing Systems, Vancouver, BC, Canada, 6–11 December 2010; Neural Information Processing Systems Foundation, Inc.: Montreal, QC, Canada, 2011. [Google Scholar]
  44. Epskamp, S.; Cramer, A.O.J.; Waldorp, L.J.; Schmittmann, V.D.; Borsboom, D. Qgraph: Network visualizations of relationships in psychometric data. J. Stat. Softw. 2012, 48, 1–18. [Google Scholar] [CrossRef] [Green Version]
  45. Leisman, G.; Moustafa, A.; Shafir, T. Thinking, Walking, Talking: Integratory Motor and Cognitive Brain Function. Front. Public Health 2016, 4, 94. [Google Scholar] [CrossRef] [Green Version]
  46. Vale, S.; Mota, J. Adherence to 24-h movement guidelines among Portuguese preschool children: The prestyle study. J. Sports Sci. 2020, 38, 1–6. [Google Scholar] [CrossRef]
  47. Hu, B.Y.; Johnson, G.K.; Wu, H. Screen time relationship of Chinese parents and their children. Child. Youth Serv. Rev. 2018, 94, 659–669. [Google Scholar] [CrossRef]
  48. Duch, H.; Fisher, E.M.; Ensari, I.; Harrington, A. Screen time use in children under 3 years old: A systematic review of correlates. Int. J. Behav. Nutr. Phys. Act. 2013, 10, 102. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Abdul Rahman, A.; Carroll, D.J.; Espy, K.A.; Wiebe, S.A. Neural Correlates of Response Inhibition in Early Childhood: Evidence From a Go/No-Go Task. Dev. Neuropsychol. 2017, 42, 336–350. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Anderson, M.; Nettelbeck, T.; Barlow, J. Reaction time measures of speed of processing: Speed of response selection increases with age but speed of stimulus categorization does not. Br. J. Dev. Psychol. 1997, 15, 145–157. [Google Scholar] [CrossRef]
  51. Wiebe, S.A.; Sheffield, T.D.; Espy, K.A. Separating the Fish From the Sharks: A Longitudinal Study of Preschool Response Inhibition. Child Dev. 2012, 83, 1245–1261. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Davidson, M.C.; Amso, D.; Anderson, L.C.; Diamond, A. Development of cognitive control and executive functions from 4 to 13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia 2006, 44, 2037–2078. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Scantlebury, N.; Cunningham, T.; Dockstader, C.; Laughlin, S.; Gaetz, W.; Rockel, C.; Dickson, J.; Mabbott, D. Relations between white matter maturation and reaction time in childhood. J. Int. Neuropsychol. Soc. 2014, 20, 99–112. [Google Scholar] [CrossRef]
  54. Carlson, S.M.; Zayas, V.; Guthormsen, A. Neural correlates of decision making on a gambling task. Child Dev. 2009, 80, 1076–1096. [Google Scholar] [CrossRef]
  55. Tremolada, M.; Taverna, L.; Bonichini, S. Which factors influence attentional functions? Attention assessed by KITAP in 105 6-to-10-year-old children. Behav. Sci. (Basel) 2019, 9, 7. [Google Scholar] [CrossRef] [Green Version]
  56. Chaplin, T.M. Gender and emotion expression: A developmental contextual perspective. Emot. Rev. 2015, 7, 14–21. [Google Scholar] [CrossRef] [Green Version]
  57. Barnett, L.M.; van Beurden, E.; Morgan, P.J.; Brooks, L.O.; Beard, J.R. Gender differences in motor skill proficiency from childhood to adolescence: A longitudinal study. Res. Q. Exerc. Sport 2010, 81, 162–170. [Google Scholar] [CrossRef] [PubMed]
  58. Iivonen, S.; Sääkslahti, A.K. Preschool children’s fundamental motor skills: A review of significant determinants. Early Child Dev. Care 2014, 184, 1107–1126. [Google Scholar] [CrossRef]
  59. Reck, S.G.; Hund, A.M. Sustained attention and age predict inhibitory control during early childhood. J. Exp. Child Psychol. 2011, 108, 504–512. [Google Scholar] [CrossRef] [PubMed]
  60. Cuevas, K.; Bell, M.A. Infant Attention and Early Childhood Executive Function. Child Dev. 2014, 85, 397–404. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  61. Sigman, A. Time for a view on screen time. Arch. Dis. Child. 2012, 97, 935–942. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  62. Cadoret, G.; Bigras, N.; Lemay, L.; Lehrer, J.; Lemire, J. Relationship between screen-time and motor proficiency in children: A longitudinal study. Early Child Dev. Care 2018, 188, 231–239. [Google Scholar] [CrossRef]
  63. Stodden, D.F.; Langendorfer, S.J.; Goodway, J.D.; Roberton, M.A.; Rudisill, M.E.; Garcia, C.; Garcia, L.E. A developmental perspective on the role of motor skill competence in physical activity: An emergent relationship. Quest 2008, 60, 290–306. [Google Scholar] [CrossRef]
  64. Radesky, J.S.; Silverstein, M.; Zuckerman, B.; Christakis, D.A. Infant self-regulation and early childhood media exposure. Pediatrics 2014, 133, e1172–e1178. [Google Scholar] [CrossRef] [Green Version]
  65. Tamana, S.K.; Ezeugwu, V.; Chikuma, J.; Lefebvre, D.L.; Azad, M.B.; Moraes, T.J.; Subbarao, P.; Becker, A.B.; Turvey, S.E.; Sears, M.R.; et al. Screen-time is associated with inattention problems in preschoolers: Results from the CHILD birth cohort study. PLoS ONE 2019, 14, e0213995. [Google Scholar] [CrossRef]
  66. Sweetser, P.; Johnson, D.; Ozdowska, A.; Wyeth, P. Active versus passive screen time for young children. Aust. J. Early Child. 2012, 37, 94–98. [Google Scholar] [CrossRef] [Green Version]
  67. Neumann, M.M. An examination of touch screen tablets and emergent literacy in Australian pre-school children. Aust. J. Educ. 2014, 58, 109–122. [Google Scholar] [CrossRef]
  68. Byeon, H.; Hong, S. Relationship between Television Viewing and Language Delay in Toddlers: Evidence from a Korea National Cross-Sectional Survey. PLoS ONE 2015, 10, e0120663. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  69. Lin, L.Y.; Cherng, R.J.; Chen, Y.J.; Chen, Y.J.; Yang, H.M. Effects of television exposure on developmental skills among young children. Infant Behav. Dev. 2015, 38, 20–26. [Google Scholar] [CrossRef] [PubMed]
  70. Thompson, D.A.; Matson, P.A.; Ellen, J.M. Television viewing in low-income latino children: Variation by ethnic subgroup and english proficiency. Child. Obes. 2013, 9, 22–28. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  71. Guerra, P.H.; de Farias Júnior, J.C.; Florindo, A.A. Sedentary behavior in Brazilian children and adolescents: A systematic review. Rev. Saude Publica 2016, 50, 9. [Google Scholar] [CrossRef]
  72. Huber, B.; Yeates, M.; Meyer, D.; Fleckhammer, L.; Kaufman, J. The effects of screen media content on young children’s executive functioning. J. Exp. Child Psychol. 2018, 170, 72–85. [Google Scholar] [CrossRef]
  73. Lillard, A.S.; Peterson, J. The immediate impact of different types of television on young children’s executive function. Pediatrics 2011, 128, 644–649. [Google Scholar] [CrossRef] [Green Version]
  74. Carson, V.; Kuzik, N.; Hunter, S.; Wiebe, S.A.; Spence, J.C.; Friedman, A.; Tremblay, M.S.; Slater, L.G.; Hinkley, T. Systematic review of sedentary behavior and cognitive development in early childhood. Prev. Med. (Baltim) 2015, 78, 115–122. [Google Scholar] [CrossRef]
  75. Draper, C.; Tomaz, S.A.; Cook, C.J.; Jugdav, S.S.; Ramsammy, C.; Besharati, S.; Van Heerden, A.; Vilakazi, K.; Cockcroft, K.; Howard, S.J.; et al. Understanding the influence of 24-hour movement behaviours on the health and development of preschool children from low-income South African settings: The SUNRISE pilot study. S. Afr. J. Sport. Med. 2020, 32, 1–7. [Google Scholar] [CrossRef]
  76. Blair, C.; Raver, C.C. Child development in the context of adversity;Experiential canalization of brain and behavior. Am. Psychol. 2012, 67, 309–318. [Google Scholar] [CrossRef]
Ijerph 17 08861 g001 550
Figure 1. Network associations between compliance with screen time recommendation, sex, body mass index, fundamental motor skills, executive functions, and age. Orange node = compliance with screen time recommendation; blue nodes = anagraphics and anthropometrics; yellow nodes = fundamental motor skills; purple nodes = executive function trials; 1 = compliance with screen time recommendation; 2 = sex; 3 = body mass index; 4 = locomotion score; 5 = object control score; 6 = accuracy of Go; 7 = reaction time of Go; 8 = accuracy of No Go; 9 = age.
Figure 1. Network associations between compliance with screen time recommendation, sex, body mass index, fundamental motor skills, executive functions, and age. Orange node = compliance with screen time recommendation; blue nodes = anagraphics and anthropometrics; yellow nodes = fundamental motor skills; purple nodes = executive function trials; 1 = compliance with screen time recommendation; 2 = sex; 3 = body mass index; 4 = locomotion score; 5 = object control score; 6 = accuracy of Go; 7 = reaction time of Go; 8 = accuracy of No Go; 9 = age.
Ijerph 17 08861 g001
Table
Table 1. Sample characteristics and differences.
Table 1. Sample characteristics and differences.
VariablesN (%)
Boys (n = 24)Girls (n = 18)Total (n = 42)x2 (p)
Screen time (min/day)
Compliant1 (4.2)3 (16.7)4 (9.6)1.87(0.172)
Noncompliant23 (95.8)15 (83.3)38 (90.4)
p (Cohen’s d)
Age (years)3.91 ± 0.773.55 ± 0.613.76 ± 0.720.112 (0.50)
BMI15.43 ± 1.1415.51 ± 2.0415.47 ± 1.570.876 (−0.04)
Locomotor26.33 ± 8.7221.0 ± 7.7724.05 ± 8.650.047 (0.64)
Object control22.04 ± 7.4517.11 ± 7.1219.93 ± 7.630.037 (0.67)
Ac-Go (score)53.25 ± 5.6247.22 ± 11.1850.67 ± 8.870.027 (0.71)
RT-Go (ms)285 ± 0.32301 ± 0.25292 ± 0.300.083 (−0.55)
Ac-No Go (score)9.37 ± 3.7611.83 ± 2.5510.42 ± 3.480.022 (−0.74)
BMI: body mass index; Ac-Go: accuracy on Go; RT-Go: reaction time on Go; Ac-NoGo: accuracy on No Go.
Table
Table 2. Weights matrix.
Table 2. Weights matrix.
VariableNetwork
123456789
Screen time (1)0.00
Sex (2)0.580.00
BMI (3)−0.520.350.00
Locomotor (4)−0.290.03−0.220.00
Object control (5)0.14−0.22−0.070.450.00
Ac-Go (6)0.33−0.490.330.08−0.250.00
RT-Go (7)−0.040.110.050.130.04−0.420.00
Ac-No Go (8)−0.260.54−0.29−0.05−0.140.270.120.00
Age (9)0.25−0.290.170.290.280.09−0.010.440.00
1 = compliance with screen time recommendation; 2 = sex; 3 = body mass index; 4 = locomotion score; 5 = object control score; 6 = accuracy of Go; 7 = reaction time of Go; 8 = accuracy of No Go; 9 = age.
Table
Table 3. Centrality measures.
Table 3. Centrality measures.
VariableBetweennessClosenessStrength
Age0.120−0.501−0.214
Screen time−0.4190.9280.939
Sex0.6591.7401.354
BMI0.120−0.1270.149
Locomotion−0.419−0.702−0.734
Object control0.242−0.781−0.633
Ac-Go 2.2750.7140.668
RT-Go−0.958−1.479−1.919
Ac-No Go−0.4190.2100.390
BMI: body mass index; Ac-Go: accuracy on Go; RT-Go: reaction time on Go; Ac-No Go: accuracy on No Go.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Martins, C.M.d.L.; Bandeira, P.F.R.; Lemos, N.B.A.G.; Bezerra, T.A.; Clark, C.C.T.; Mota, J.; Duncan, M.J. A Network Perspective on the Relationship between Screen Time, Executive Function, and Fundamental Motor Skills among Preschoolers. Int. J. Environ. Res. Public Health 2020, 17, 8861. https://doi.org/10.3390/ijerph17238861

AMA Style

Martins CMdL, Bandeira PFR, Lemos NBAG, Bezerra TA, Clark CCT, Mota J, Duncan MJ. A Network Perspective on the Relationship between Screen Time, Executive Function, and Fundamental Motor Skills among Preschoolers. International Journal of Environmental Research and Public Health. 2020; 17(23):8861. https://doi.org/10.3390/ijerph17238861

Chicago/Turabian Style

Martins, Clarice Maria de Lucena, Paulo Felipe Ribeiro Bandeira, Natália Batista Albuquerque Goulart Lemos, Thaynã Alves Bezerra, Cain Craig Truman Clark, Jorge Mota, and Michael Joseph Duncan. 2020. "A Network Perspective on the Relationship between Screen Time, Executive Function, and Fundamental Motor Skills among Preschoolers" International Journal of Environmental Research and Public Health 17, no. 23: 8861. https://doi.org/10.3390/ijerph17238861

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop