Next Article in Journal
Physical Examination Tool for Swollen and Tender Lower Limb Joints in Juvenile Idiopathic Arthritis: A Pilot Diagnostic Accuracy Study
Previous Article in Journal
Does Trust Help to Improve Residents’ Perceptions of the Efficacy of Disaster Preparedness? Evidence from Wenchuan and Lushan Earthquakes in Sichuan Province, China
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 19
Issue 8
10.3390/ijerph19084521
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Impact of Residential Concentration of PM2.5 Analyzed as Time-Varying Covariate on the Survival Rate of Lung Cancer Patients: A 15-Year Hospital-Based Study in Upper Northern Thailand

by
Nawapon Nakharutai
1,2,
Patrinee Traisathit
1,2,3,
Natthapat Thongsak
1,
Titaporn Supasri
4,
Pimwarat Srikummoon
1,2,
Salinee Thumronglaohapun
1,2,
Phonpat Hemwan
5 and
Imjai Chitapanarux
6,7,*
1
Department of Statistics, Faculty of Science, Chiang Mai University, Chiang Mai 50200, Thailand
2
Data Science Research Center, Department of Statistics, Faculty of Science, Chiang Mai University, Chiang Mai 50200, Thailand
3
Research Center in Bioresources for Agriculture, Industry and Medicine, Department of Statistics, Faculty of Science, Chiang Mai University, Chiang Mai 50200, Thailand
4
Atmospheric Research Unit, National Astronomical Research Institute of Thailand, Chiang Mai 50180, Thailand
5
Department of Geography, Faculty of Social Sciences, Chiang Mai University, Chiang Mai 50200, Thailand
6
Northern Thai Research Group of Therapeutic Radiology and Oncology (NTRG-TRO), Divisions of Radiation Oncology, Faculty of Medicine, Chiang Mai University, Chiang Mai 50200, Thailand
7
Chiang Mai Cancer Registry, Maharaj Nakorn Chiang Mai Hospital, Faculty of Medicine, Chiang Mai University, Chiang Mai 50200, Thailand
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(8), 4521; https://doi.org/10.3390/ijerph19084521
Submission received: 5 March 2022 / Revised: 1 April 2022 / Accepted: 6 April 2022 / Published: 8 April 2022
(This article belongs to the Section Air)
Browse Figures
Versions Notes

Abstract

:
Air pollutants, especially particulate matter (PM) ≤ 2.5 µm (PM2.5) and PM ≤ 10 µm (PM10), are a major concern in upper northern Thailand. Data from a retrospective cohort comprising 9820 lung cancer patients diagnosed from 2003 to 2018 were obtained from the Chiang Mai Cancer Registry, and used to evaluate mortality and survival rates. Cox proportional hazard models were used to identify the association between the risk of death and risk factors including gender, age, cancer stage, smoking history, alcohol-use history, calendar year of enrollment, and time-updated PM2.5, PM10, NO2 and O3 concentrations. The mortality rate was 68.2 per 100 persons per year of follow-up. In a multivariate analysis, gender, age, cancer stage, calendar year of enrollment, and time-varying residential concentration of PM2.5 were independently associated with the risk of death. The lower the annually averaged PM2.5 and PM10 concentrations, the higher the survival probability of the patient. As PM2.5 and PM10 were factors associated with a higher risk of death, lung cancer patients who are inhabitant in the area should reduce their exposure to high concentrations of PM2.5 and PM10 to increase survival rates.

1. Introduction

Air pollution, mainly from outdoor pollution sources, kills more than 4.2 million people worldwide each year, and 9 out of 10 people live in places where the air quality is worse than the WHO guidelines [1]. As this is a long-term issue that is yet to be resolved, it is critical to comprehensively investigate the impact and provide solutions. In 2020, lung cancer accounted for 12.4% of new cancer cases and 16.3% of cancer-related deaths in Thailand, which was second only to liver cancer [2]. Meanwhile, a new strategy to enhance lung cancer treatment has been developed [3]. Lung cancer deaths in northern Thailand have increased steadily, at a rate much higher than in other regions of the country [4,5]. From 1997 to 2017, Lampang Cancer Hospital recorded an increase, from 1700 to 2400, in new lung cancer cases per year in the northern region, while the number of lung cancer-specific deaths rose from 1200 to 1800 per year [6].
Deaths of lung cancer patients are caused by various risk factors, the main one being smoking [7,8,9,10,11,12]. A large Norwegian study found that men who smoke had a 27-fold higher risk of death [12]. Other characteristics related to the mortality of lung cancer are sex (men have a higher risk than women) [7,12], age (a higher risk with increasing age) [7,10,11], body mass index (being overweight is riskier) [13,14], family history [8,10], and cancer stage [7,15]. Furthermore, external factors such as air pollution can have a significant effect on mortality; for example, PM (both PM ≤ 2.5 µm (PM2.5) [16,17,18,19,20,21,22,23] and PM ≤ 10 µm (PM10) [19,22,23,24,25,26,27]), NO2 [22,23] and O3 [28].
A PM crisis occurred in the first half of the year in major cities due to forest fires, the burning of agricultural waste (rice, corn, and sugarcane), cross-border pollution, and traffic and transport [29]. Accurate diagnosis of lung cancer (especially the staging) is crucial and must comply with international standards. Since excellent diagnostic tools are essential, and are only available in university-based hospitals, referring the many suspected lung cancer patients to them has created an inevitable burden on healthcare, equipment costs, and has inevitably complicated procedures. Moreover, socioeconomic status and economic conditions are also related confounding factors [30]. Chiang Mai province, surrounded by high mountains that block diffusion and redirect airflow, is an example of exacerbating PM accumulation along the foothills of mountains [31,32]. Therefore, this province has a problem with severe air pollution from PM [33]. Since the concentrations of PM, NO2 and O3 have been changing over time, they can be treated as time-varying covariates whose values can change over the duration of follow-up [34]. Cox proportional hazard models have been extensively used in the analysis of time-varying covariates, in order to investigate the association between events and variables over time [35]. Although Cox proportional hazard models have been applied in many survival-time studies, for instance [35,36,37,38], there is no study that has taken the concentration of PM, NO2 and O3 as the time-varying covariates when examining survival rates of lung cancer patients. To address this issue, our investigation will be the first study to use PM2.5, PM10, NO2, and O3 levels over the past 15 years as time-varying covariates in the Cox proportional hazard model to estimate the mortality rate, and to identify the risk factors associated with mortality among lung cancer patients. The data were collected during a 15-year hospital-based study in upper northern Thailand.

2. Methodology

2.1. The Study Population

Patients who were diagnosed with lung cancer between 1 January 2003 and 31 December 2018 were followed-up from their date of registration to the end of 2020, in order to determine their survival rates.
This study focused on Thailand’s northern region. This region comprises the provinces of Chiang Rai, Mae-Hong-Son, Chiang Mai, Phayao, Lamphun, Lampang, Phrae, and Nan. The majority of northern Thailand is hilly, and it is the source of several important rivers. The north–south oriented hill ridges run parallel from west to east and are intersected by several major valleys. The northern region’s agricultural land is estimated to be 6,368,630 hectares, accounting for 40% of total land use, as shown in Figure 1. Of this, approximately 41% is paddy fields and 32% is field crops [39].

2.2. Exposure Assessment for Time-Updated Variables

We obtained hourly monitoring data for PM2.5, PM10, NO2, and O3 levels from the Copernicus Atmosphere Monitoring Service (CAMS) of the European Centre for Medium-Range Weather Forecasts (ECMWF) [40,41]. This is the latest global reanalysis dataset of atmospheric composition, consisting of three-dimensional time-consistent atmospheric composition fields that include aerosols and chemical species. The dataset can be used for climatology computations to analyze trends, examine models, compare them to other re-analyses, or serve as the boundary conditions for regional models over time [42]. The annually averaged concentrations of PM2.5 (µg/m3), PM10 (µg/m3), NO2 (ppb) and O3 (ppb) were then calculated based on the hourly concentration in each district of upper northern Thailand. We then linked the annually averaged concentration of each pollutant to the district listed in each patient’s address and the calendar year of their diagnosis obtained from the Chiang Mai Cancer Registry and updated every year until either patient death, patient lost to follow-up or loss of data due to censoring. It was assumed that the patients’ recorded addresses were where they lived and subsequently died.

2.3. Baseline and Follow-Up Data

The Chiang Mai Cancer Registry provided individual-level information for each cancer patient at diagnosis, including demographics (gender, age, body mass index (BMI), smoking history, and alcohol-use history) and cancer characteristics (cancer stage—SEER staging: localized, regional, or metastasis). Even though the role of alcohol consumption in the occurrence of lung cancer is still controversial, several studies [43,44,45,46] have reported a strong positive association between drinking alcohol and smoking. There might be confounding effect between these variables. In addition, a previous study among patients with non-small-cell lung cancer in the US also found that those patients with alcohol-abuse habits have worse outcomes than non-alcohol-abusing patients [47]. Alcohol-use history was therefore included in the analysis to allow for consideration of its effect on the mortality of lung cancer patients. Every year, the concentrations of PM2.5, PM10, NO2, and O3 that each patient was exposed to were measured by using the pollution dataset detailed in Section 2.2.

2.4. Statistical Analysis

The baseline characteristics are presented as medians and interquartile ranges (IQRs) for the continuous variables, and as frequencies and percentages for the categorical variables. The follow-up time was calculated from the date of diagnosis to either the date of death, regardless of the cause, to the last follow-up date, or to loss of data due to censoring by using the end of the study period (31 December 2020), depending on which came first.
The overall rate of death, and the rates for each variable, were calculated as the number of deaths divided by the total number of person years of follow-up (PYFU). Confidence intervals (CIs) for the mortality rates were based on a Poisson distribution. Survival rates were created by using Kaplan–Meier curves, and log-rank tests were used to test for significance in the difference between the survival probabilities of the groups for each variable.
Cox proportional hazard models were used to investigate any associations between the risk of death among lung cancer patients and the risk factors, including gender, age, cancer stage, smoking history, alcohol-use history, calendar year of enrollment, and time-updated PM2.5, PM10, NO2, and O3 concentrations. All of the continuous variables were grouped using quartiles, and considered for dichotomization where appropriate (except for BMI with categories: <18.5 and ≥18.5 kg/m2, due to the cut-off point recommended in [48]). Factors associated with the risk of death with p-value < 0.25 in the univariate analysis were included in the multivariate analysis via a backward elimination procedure, except for variables with a lot of missing values or high correlations (multicollinearity). All analyses were performed by using STATA (version 12).

2.5. Ethical Approval

Ethical approval was granted by the Chiang Mai University Ethics Committee (No 200/2021) in the Faculty of Medicine.

3. Results

A total of 9820 lung cancer patients were registered between January 2003 and December 2018, 5892 (60%) of whom were males. For the baseline, the median age was 64.0 years (IQR: 56.0–71.7) and the median BMI was 20.1 kg/m2 (IQR: 17.8–22.7). For the residential concentration of air pollutants at diagnosis, the median for PM2.5 was 37.4 µg/m3 (IQR: 33.8–41.1), the median for PM10 was 52.1 µg/m3 (IQR: 47.1–57.1), the median for NO2 was 7.6 ppb (IQR: 5.6–8.8) and the median for O3 was 36.2 ppb (IQR: 34.9–37.3). For the lung cancer staging, patients were divided into three groups: 21% for localized, 19% for regional, and 61% for metastatic. Furthermore, 78% of patients had a history of smoking, while 55% had a history of alcohol use. The median duration of follow-up was 1.0 years (IQR: 0.52–3.52). During the follow-up period, the median survival time was 0.52 years (IQR: 0.19–1.27).

3.1. Baseline Characteristics and Mortality Rate

A total number of 9170 patients died from all causes, with 13,451 PYFU, giving an overall mortality rate of 68.2 per 100 PYFU (95% CI: 66.8–69.6) (Table 1). The mortality rate was 71.8 per 100 PYFU in men (95% CI: 70.7–73.7) and 63.6 per 100 PYFU in women (95% CI: 61.3–65.4). Age at diagnosis ≥ 60 years revealed a high mortality rate of 77.6 per 100 PYFU (95% CI: 75.6–79.6). Being underweight with low BMI had high mortality rates of, specifically, 75.2 per 100 PYFU for weight <50 kg (95% CI: 72.7–77.9), and 77.8 per 100 PYFU for BMI <18.5 kg/m2 (95% CI: 73.8–81.9). Concerning the three cancer stages, the highest mortality rate was found for the metastatic stage (108.0 per 100 PYFU; 95% CI: 105.2–110.9). Smoking and alcohol-use history also provided high mortality rates of 73.6 per 100 PYFU (95% CI: 71.8–75.6) and 69.5 per 100 PYFU (95% CI: 67.2–71.9), respectively. Finally, there was only a small difference for the calendar year of enrollment.

3.2. Risk Factors Associated with Death

The results of the uni- and multi-variate analyses for determining the risk factors for death in the lung cancer patients are reported in Table 2. In the univariate analysis, being male, older age, lower BMI, cancer in the metastatic stage, a history of smoking or alcohol-use, enrollment between 2003 and 2010, and time-updated residential concentrations of PM2.5 and PM10, were all associated with a higher risk of death in the lung cancer patients (all p-values ≤ 0.001), but as the time-updated residential concentrations of NO2 and O3 showed p-values of 0.543 and 0.782, respectively, the residential concentrations of NO2 and O3 were not included in the multivariate model. However, we found that BMI, smoking history, and alcohol-use history had a lot of missing values (53.4%, 20.3%, and 33.5%, respectively), so including these variables would have excluded a large number of patients from the multivariate analysis and could have led to invalid results. Therefore, in the multivariate analysis, those variables with a lot of missing values were excluded. In addition, the residential concentration of PM10 was also excluded due to its correlation with the residential concentration of PM2.5. Thus, the multivariate analysis included only gender, age, cancer stage, calendar year of enrollment, and time-updated residential concentration of PM2.5. We found that all included parameters were independently associated with the risk of death (all p-values < 0.001). Specifically, the metastatic stage was associated with a higher risk of death with the highest adjusted hazard ratio (aHR) = 2.13 (95% CI: 2.01–2.25). Meanwhile, being male (aHR = 1.17; 95% CI: 1.11–1.22), being older (aHR = 1.28; 95% CI: 1.22–1.33), the regional cancer stage (aHR = 1.32; 95% CI: 1.23–1.41), enrolling before 2010 (aHR = 1.30; 95% CI: 1.24–1.36), and time-updated residential concentration of PM2.5 (aHR = 1.06; 95% CI:1.01–1.11) were also associated with a higher risk of death.

3.3. Survival Probabilities

The impact of diagnosis time on survival is illustrated in Figure 2. Within the first three years of diagnosis, the survival probability dramatically dropped to 10%, with the number of deaths being 8690. After three years since diagnosis, the survival probability slowly decreased throughout the follow-up period. Only a few people were still alive six years after diagnosis. Additionally, Figure 3 shows the impact of gender on survival time. It can be seen that the survival probability of males was slightly lower than females.
The impact of air pollutants on survival time is presented in Figure 4 and Figure 5. It can be inferred that the survival probabilities of patients who lived in an area where annually averaged PM2.5 ≥ 40 µg/m3 was slightly lower than where it was <40 µg/m3 (p-value = 0.0013). Similarly, the survival probability of those who lived in an area where annually averaged PM10 ≥ 55 µg/m3 was slightly lower than where it was <55 µg/m3.

4. Discussion

We investigated the mortality rate in a large cohort of lung cancer patients in the upper northern area of Thailand. Being male (60%) and being relatively older (median age of 64.0, IOR = 56.0–71.7) displayed higher mortality rates than other factors, which is similar to the findings from other studies [49,50]. This may explain why the overall mortality rate in our study was 68.2 per 100 PYFU, a rate that is consistent with that from the Mazandaran University of Medical Science study on lung cancer patients collected from Tooba Clinic in Sari, Mazandaran Province, Iran (46.8 per 100 person years) [50], but much higher than that reported by the Taiwan Cancer Registry study with/without Chinese herbal treatment (40.24/49.56 per 100 person years) [51]. Note that the contributions of older age and stage of cancer to the risk of death are well-known to be major [52], which was confirmed by the results of the present study.
Most of the risk factors for lung cancer (male, older age, lower BMI, metastatic cancer stage, smoking history, alcohol-use history, enrollment between 2003 and 2010, and time-updated residential concentration of PM) in the univariate analyses are well-known, and our results are consistent with those from other studies [8,53,54,55]. On the other hand, the time-updated residential concentration of NO2 and O3 are not significantly associated with death from lung cancer, which is different from most other studies [22,23,28], but similar to [56] for O3. In the multivariate analyses, we found that all of the input risk factors (male, older age, stage of cancer, early enrollment time, and residential concentration of PM2.5) are associated with a higher risk of death in lung cancer patients, and this is in agreement with the findings from other studies [8,20,22,23,57,58,59].
According to the survival rates, less than 10% of lung cancer patients survived longer than three years after diagnosis, regardless of the residential concentration of air pollution. This result is consistent with the report from the Office for National Statistics that the percentage of lung cancer patients decreased after five years since diagnosis, and only 7.6% of men and 11.3% of women are expected to survive the disease for more than ten years [60]. However, there is a significant difference between the survival times of lung cancer patients living in districts with annually averaged concentrations of PM2.5 < 40 µg/m3 and ≥40 µg/m3. Similarly, there is a significant difference between those living in areas with annually averaged concentrations of PM10 < 55 µg/m3 and ≥55 µg/m3. In both cases, the higher the concentration of air pollution, the lower the survival rate. Of note, early enrollment time, which was associated with a higher risk of death, was seen in patients with more exposure to PM2.5 and PM10 pollutants. Therefore, patients living in the areas severely affected by high levels of air pollution had a shorter survival time, which is consistent with the results reported by [20].
Note that lung cancer patients comprise a sensitive group that lives in areas with PM2.5 and PM10 concentrations over both the Thai (25 and 50 µg/m3, respectively) and WHO (10 and 20 µg/m3, respectively) maximum average allowable concentrations [61]. However, we could not perform our analysis at these levels since the PM data are left-skewed. In other words, the PM2.5 and PM10 in our study areas were higher than the standard levels. Thus, in our analysis, we grouped them using quartiles and by choosing a suitable dichotomization. Together with studies on the impact of air pollution on other diseases [55,62], our results on the effects of PM2.5 and PM10 on lung cancer patients indicate that the severe issue of air pollution, especially in the northern areas of Thailand, should be resolved.
Apart from the air pollution, the causes of the poor survival outcome of patients in this study might be from the quality of the diagnosis and treatment of lung cancer, together with limitations in healthcare resources, including facilities and medical personnel. A computed tomography (CT) scan is routinely performed for diagnosis in Thailand, according to national guideline. However, the image quality is not good enough in some rural hospitals. Recently, the Thoracic Society of Thailand under Royal Patronage developed clinical practice guidelines for lung cancer diagnosis [30]. The evolving technologies for treatment, including surgery and radiotherapy, have rapidly progressed in Thailand in the past ten years [30]. Nevertheless, the accessibility of novel chemotherapeutic or targeted drugs used for advanced stages of lung cancer is limited for most Thai patients [30].
Our study had several strengths. First, this was a very large hospital-based cohort study that was sufficient for providing results on lung cancer mortality and survival rates. Second, the lung cancer patients’ data, as well as the data on air pollutants, were collected over a 15-year period (2003–2020). Finally, this is the first investigation that has applied time-varying covariate analysis to PM data to test whether fine PM, along with other risk factors, affects the survival rate of lung cancer patients. Meanwhile, meteorological factors (such as temperature, humidity, and wind speed) that are significantly associated with lung cancer mortality [22,23] might be considered in a future study.
Nevertheless, the study also has the following limitations. First, the residential concentrations of air pollutants were calculated under the assumption that the patients mostly lived and died in the district in which they were registered. In fact, it is possible that the patients indeed stayed in other districts with higher or lower residential concentrations of PM than their home districts. To resolve this issue in a similar study in the future, we might have to recheck whether the patients mostly lived and died in their registered districts or not, and hence we would have to exclude any patient who does not meet this criterion. Second, many values for weight, BMI, smoking history, and alcohol-use history were missing, and so these factors could not be included in the multivariate Cox proportional hazard analysis. Hence, an appropriate method to impute these missing values, such as the Multivariate Imputation by Chained Equation (MICE) could be applied [63]. This could compensate for the missing values of those variables and lead to adjustment of the multivariate analysis for the mortality risk of lung cancer patients. Another limitation in this study is that the details of treatment for each lung cancer patient recorded in the hospital medical record were not systematically combined with the Chiang Mai Cancer Registry. Therefore, we could not perform any investigation on this aspect. In the case that the treatment data from the hospital medical records and the data in the Chiang Mai Cancer Registry can be systematically combined, analysis on the impact of treatments associated with lung cancer mortality might be performed.
Lastly, the Chiang Mai Cancer Registry has recorded the lung cancer patients’ data based on the IARC CanReg5 tool. The IARC CanReg5 tool does not record the patients’ lung cancer stages nor the type of lung cancer (small cell or non-small cell). Therefore, we were unable to present and analyze these characteristics in this study. As these characteristics can be obtained from the clinical cancer registry, which has not been applied to the Chiang Mai Cancer Registry, in the future, analyses from the clinical cancer registry could provide a better understanding of the association between lung cancer mortality and risk factors.

5. Conclusions

In summary, we found that the mortality rate of lung cancer patients in upper northern Thailand was high, and the mortality risk factors were sex (male), older age, the stage of cancer, and the amount and period of exposure to PM2.5 and PM10. The fact that concentrations of these air pollutants comprise one of the risk factors associated with a higher risk of death from lung cancer indicates that air pollution is a major problem in the upper northern part of Thailand that needs to be addressed. While the severe problem of PM2.5 and PM10 is still waiting to be fixed, lung cancer patients who live in such areas should reduce their exposure to fine particulate matter in order to increase their survival rate.

Author Contributions

Conceptualization, N.N., P.T. and I.C.; formal analysis N.T. and P.T.; resources, data curation, T.S., P.H. and I.C.; writing—original draft preparation, N.N., P.T. and N.T.; writing—review and editing, N.N., P.T., N.T., S.T., P.S. and I.C.; funding acquisition, I.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Faculty of Medicine, Chiang Mai University, Thailand.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Research Ethics Committee No.4, Faculty of Medicine, Chiang Mai University (protocol code RAD-2564-08089 and date of approval: 24 May 2021).

Informed Consent Statement

Not applicable.

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Acknowledgments

We acknowledge the Chiang Mai Cancer Registry, Maharaj Nakorn Chiang Mai Hospital, Faculty of Medicine and Chiang Mai University for supporting the current study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. WHO Global Air Quality Guidelines: Particulate Matter (PM2.5 and PM10), Ozone, Nitrogen Dioxide, Sulfur Dioxide and Carbon Monoxide; WHO: Geneva, Switzerland, 2021. [Google Scholar]
  2. World Health Organization. Thailand-Global Cancer Observatory; WHO: Geneva, Switzerland, 2020. [Google Scholar]
  3. Radmilović-Radjenović, M.; Sabo, M.; Prnova, M.; Šoltes, L.; Radjenović, B. Finite Element Analysis of the Microwave Ablation Method for Enhanced Lung Cancer Treatment. Cancers 2021, 13, 3500. [Google Scholar] [CrossRef] [PubMed]
  4. Rankantha, A.; Chitapanarux, I.; Pongnikorn, D.; Prasitwattanaseree, S.; Bunyatisai, W.; Sripan, P.; Traisathit, P. Risk Patterns of Lung Cancer Mortality in Northern Thailand. BMC Public Health 2018, 18, 1138. [Google Scholar] [CrossRef] [PubMed]
  5. Pongnikorn, D.; Daoprasert, K.; Waisri, N.; Laversanne, M.; Bray, F. Cancer Incidence in Northern Thailand: Results from Six Population-Based Cancer Registries 1993–2012. Int. J. Cancer 2018, 142, 1767–1775. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Lampang Cancer Hospital. Trend in Cancer Incidence and Mortality in Northern Thailand, 1993–2017; LPCH: Lampang, Thailand, 2018. [Google Scholar]
  7. Salehi, M.; Salehi, M.; Shahidsales, S.; Goshayeshi, G.; Emadzadeh, M.; Toosi, M.S.; Aledavood, S.-A.; Hoseini, S.S.; Shojaei, P. Epidemiology of Lung Cancer in Northeast of Iran: A 25-year Study of 939 Patients. Med. J. Islam. Repub. Iran 2020, 34, 17. [Google Scholar] [CrossRef]
  8. Malhotra, J.; Malvezzi, M.; Negri, E.; La, V.C.; Boffetta, P. Risk Factors for Lung Cancer Worldwide. Eur. Respir. J. 2016, 48, 889–902. [Google Scholar] [CrossRef] [Green Version]
  9. Roy, M.P. Factors Associated with Mortality from Lung Cancer in India. Curr. Probl. Cancer 2020, 44, 100512. [Google Scholar] [CrossRef]
  10. Macek, P.; Biskup, M.; Terek-Derszniak, M.; Manczuk, M.; Krol, H.; Naszydlowska, E.; Smok-Kalwat, J.; Gozdz, S.; Zak, M. Competing Risks of Cancer and Non-Cancer Mortality When Accompanied by Lifestyle-Related Factors—A Prospective Cohort Study in Middle-Aged and Older Adults. Front. Oncol. 2020, 10, 545078. [Google Scholar] [CrossRef]
  11. Jamaati, H.; Baghaei, P.; Sharifianfard, M.; Emami, H.; Najmi, K.; Seifi, S.; Salimi, B.; Pourabdollah, M.; Kiani, A.; Hashemian, M.; et al. Risk Factors for Lung Cancer Mortality in a Referral Center. Asian Pac. J. Cancer Prev. 2016, 17, 2877–2881. [Google Scholar]
  12. Hansen, M.S.; Licaj, I.; Braaten, T.; Langhammer, A.; Le Marchand, L.; Gram, I.T. Sex Differences in Risk of Smoking-Associated Lung Cancer: Results from a Cohort of 600,000 Norwegians. Am. J. Epidemiol. 2018, 187, 971–981. [Google Scholar] [CrossRef]
  13. Zhu, H.; Zhang, S. Body Mass Index and Lung Cancer Risk in Never Smokers: A Meta-Analysis. BMC Cancer 2018, 18, 635. [Google Scholar] [CrossRef]
  14. Ardesch, F.H.; Ruiter, R.; Mulder, M.; Lahousse, L.; Stricker, B.H.C.; Kiefte-de Jong, J.C. The Obesity Paradox in Lung Cancer: Associations with Body Size versus Body Shape. Front. Oncol. 2020, 10, 591110. [Google Scholar] [CrossRef] [PubMed]
  15. Lyu, R. Survival Analysis of Lung Cancer Patients from TCGA Cohort. Adv. Lung Cancer 2020, 9, 1–15. [Google Scholar] [CrossRef] [Green Version]
  16. Wong, C.M.; Tsang, H.; Lai, H.K.; Thomas, G.N.; Lam, K.B.; Chan, K.P.; Zheng, Q.; Ayres, J.G.; Lee, S.Y.; Lam, T.H.; et al. Cancer Mortality Risks from Long-Term Exposure to Ambient Fine Particle. Cancer Epidemiol. Biomark. Prev. 2016, 25, 839–845. [Google Scholar] [CrossRef] [Green Version]
  17. Rojas-Rueda, D.; Alsufyani, W.; Herbst, C.; AlBalawi, S.; Alsukait, R.; Alomran, M. Ambient Particulate Matter Burden of Disease in the Kingdom of Saudi Arabia. Environ. Res. 2021, 197, 111036. [Google Scholar] [CrossRef] [PubMed]
  18. Liu, X.; Mubarik, S.; Wang, F.; Yu, Y.; Wang, Y.; Shi, F.; Wen, H.; Yu, C. Lung Cancer Death Attributable to Long-Term Ambient Particulate Matter (PM(2.5)) Exposure in East Asian Countries During 1990–2019. Front. Med. 2021, 8, 742076. [Google Scholar] [CrossRef] [PubMed]
  19. Chung, C.Y.; Yang, J.; He, J.; Yang, X.; Hubbard, R.; Ji, D. An Investigation into the Impact of Variations of Ambient Air Pollution and Meteorological Factors on Lung Cancer Mortality in Yangtze River Delta. Sci. Total Environ. 2021, 779, 146427. [Google Scholar] [CrossRef] [PubMed]
  20. Cao, Q.; Rui, G.; Liang, Y. Study on PM2.5 Pollution and the Mortality due to Lung Cancer in China Based on Geographic Weighted Regression Model. BMC Public Health 2018, 18, 925. [Google Scholar] [CrossRef]
  21. Bowe, B.; Xie, Y.; Yan, Y.; Al-Aly, Z. Burden of Cause-Specific Mortality Associated with PM2.5 Air Pollution in the United States. JAMA Netw. Open 2019, 2, e1915834. [Google Scholar] [CrossRef] [Green Version]
  22. Wang, J.; Li, R.; Xue, K.; Fang, C. Analysis of Spatio-Temporal Heterogeneity and Socioeconomic driving Factors of PM2.5 in Beijing–Tianjin–Hebei and Its Surrounding Areas. Atmosphere 2021, 12, 1324. [Google Scholar] [CrossRef]
  23. Olschewski, P.; Kaspar-Ott, I.; Koller, S.; Schenkirsch, G.; Trepel, M.; Hertig, E. Associations between Weather, Air Quality and Moderate Extreme Cancer-Related Mortality Events in Augsburg, Southern Germany. Int. J. Environ. Res. Public Health 2021, 18, 11737. [Google Scholar] [CrossRef]
  24. Uccelli, R.; Mastrantonio, M.; Altavista, P.; Caiaffa, E.; Cattani, G.; Belli, S.; Comba, P. Female Lung Cancer Mortality and Long-Term Exposure to Particulate Matter in Italy. Eur. J. Public Health 2017, 27, 178–183. [Google Scholar] [CrossRef] [PubMed]
  25. Moon, D.H.; Kwon, S.O.; Kim, S.Y.; Kim, W.J. Air Pollution and Incidence of Lung Cancer by Histological Type in Korean Adults: A Korean National Health Insurance Service Health Examinee Cohort Study. Int. J. Environ. Res. Public Health 2020, 17, 915. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Lamichhane, D.K.; Kim, H.C.; Choi, C.M.; Shin, M.H.; Shim, Y.M.; Leem, J.H.; Ryu, J.S.; Nam, H.S.; Park, S.M. Lung Cancer Risk and Residential Exposure to Air Pollution: A Korean Population-Based Case-Control Study. Yonsei Med. J. 2017, 58, 1111–1118. [Google Scholar] [CrossRef]
  27. Consonni, D.; Carugno, M.; De Matteis, S.; Nordio, F.; Randi, G.; Bazzano, M.; Caporaso, N.E.; Tucker, M.A.; Bertazzi, P.A.; Pesatori, A.C.; et al. Outdoor Particulate Matter (PM10) Exposure and Lung Cancer Risk in the EAGLE Study. PLoS ONE 2018, 13, e0203539. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Jerrett, M.; Burnett, R.T.; Pope, C.A., 3rd; Ito, K.; Thurston, G.; Krewski, D.; Shi, Y.; Calle, E.; Thun, M. Long-term ozone exposure and mortality. N. Engl. J. Med. 2009, 360, 1085–1095. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. National Cancer Institute. Hospital-Based Cancer Registry; NCI: Bangkok, Thailand, 2020. (In Thai) [Google Scholar]
  30. Reungwetwattana, T.; Oranratnachai, S.; Puataweepong, P.; Tangsujaritvijit, V.; Cherntanomwong, P. Lung Cancer in Thailand. J. Thorac. Oncol. 2020, 15, 1714–1721. [Google Scholar] [CrossRef]
  31. Wiriya, W.; Prapamontol, T.; Chantara, S. PM10-bound polycyclic aromatic hydrocarbons in Chiang Mai (Thailand): Seasonal variations, source identification, health risk assessment and their relationship to air-mass movement. Atmos. Res. 2013, 124, 109–122. [Google Scholar] [CrossRef]
  32. Suwanwaree, P.; Phayungwiwatthanakoon, C.; Dasananda, S. Application of new MODIS-based aerosol index for air pollution severity assessment and mapping in upper northern Thailand. Environ. Asia 2014, 7, 133–141. [Google Scholar]
  33. Wattananikorn, K.; Emharuthai, S.; Wanaphongse, P. A feasibility study of geogenic indoor radon mapping from airborne radiometric survey in northern Thailand. Radiat. Meas. 2008, 43, 85–90. [Google Scholar] [CrossRef]
  34. Austin, P.C.; Latouche, A.; Fine, J.P. A Review of the Use of Time-Varying Covariates in the Fine-Gray Subdistribution Hazard Competing Risk Regression Model. Stat. Med. 2020, 39, 103–113. [Google Scholar] [CrossRef]
  35. Lloyd, D.; Fisher, L.D.; Lin, D.Y. Time-Dependent Covariates in the Cox Proportional-Hazards Regression Model. Annu. Rev. Public Health 1999, 20, 145–157. [Google Scholar]
  36. Zhang, Z.; Reinikainen, J.; Adeleke, K.A.; Pieterse, M.E.; Groothuis-Oudshoorn, C. Time-Varying Covariates and Coefficients in Cox Regression Models. Ann. Transl. Med. 2018, 6, 121. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Bellera, C.A.; MacGrogan, G.; Debled, M.; de Lara, C.T.; Brouste, V.; Mathoulin-Pélissier, S. Variables with Time-Varying Effects and the Cox Model: Some Statistical Concepts Illustrated with a Prognostic Factor Study in Breast Cancer. BMC Med. Res. Methodol. 2010, 10, 20. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Zhang, M.J. Cox proportional hazards regression models for survival data in cancer research. In Biostatistical Applications in Cancer Research; Beam, C., Ed.; Springer: Boston, MA, USA, 2002; Volume 113, pp. 59–70. [Google Scholar]
  39. Land Development Department. Available online: https://www.ldd.go.th/web_eng56/Land_Resources/Landuse_Data_in_Thailand/Land-Use-Types-of-Thailand.html (accessed on 29 March 2022).
  40. Benedetti, A.; Morcrette, J.J.; Boucher, O.; Dethof, A.; Engelen, R.J.; Fisher, M.; Flentje, H.; Huneeus, N.; Jones, L.; Kaiser, J.; et al. Aerosol Analysis and Forecast in the European Centre for Medium-Range Weather Forecasts Integrated Forecast System: 2. Data Assimilation. J. Geophys. Res. 2009, 114, D13205. [Google Scholar] [CrossRef] [Green Version]
  41. Morcrette, J.J.; Boucher, O.; Jones, L.; Salmond, D.; Bechtold, P.; Beljaars, A. Aerosol Analysis and Forecast in the European Centre for Medium-Range Weather Forecasts Integrated Forecast System: Forward Modeling. J. Geophys. Res. 2009, 114, D06206. [Google Scholar] [CrossRef]
  42. Inness, A.; Ades, M.; Agustí-Panareda, A.; Barré, J.; Benedictow, A.; Blechschmidt, A.M.; Dominguez, J.J.; Engelen, R.; Eskes, H.; Flemming, J.; et al. The CAMS Reanalysis of Atmospheric Composition. Atmos. Chem. Phys. 2019, 19, 3515–3556. [Google Scholar] [CrossRef] [Green Version]
  43. Prescott, E.; Grønbaek, M.; Becker, U.; Sørensen, T.I. Alcohol intake and the risk of lung cancer: Influence of type of alcoholic beverage. Am. J. Epidemiol. 1999, 149, 463–470. [Google Scholar] [CrossRef] [Green Version]
  44. De Leon, J.; Rendon, D.M.; Baca-Garcia, E.; Aizpuru, F.; González-Pinto, A.M.; Anitua, C.; Diaz, F.J. Association between smoking and alcohol use in the general population: Stable and unstable odds ratios across two years in two different countries. Alcohol Alcohol. 2007, 42, 252–257. [Google Scholar] [CrossRef]
  45. Bagnardi, V.; Randi, G.; Lubin, J.; Consonni, D.; Lam, T.K.; Subar, A.F.; Goldstein, A.M.; Wacholder, S.; Bergen, A.W.; Tucker, M.A.; et al. Alcohol consumption and lung cancer risk in the Environment and Genetics in Lung Cancer Etiology (EAGLE) study. Am. J. Epidemiol. 2010, 171, 36–44. [Google Scholar] [CrossRef] [Green Version]
  46. Beard, E.; West, R.; Michie, S.; Brown, J. Association between smoking and alcohol-related behaviours: A time-series analysis of population trends in England. Addiction 2017, 112, 1832–1841. [Google Scholar] [CrossRef]
  47. Paull, D.E.; Updyke, G.M.; Baumann, M.A.; Chin, H.W.; Little, A.G.; Adebonojo, S.A. Alcohol abuse predicts progression of disease and death in patients with lung cancer. Ann. Thorac. Surg. 2005, 80, 1033–1039. [Google Scholar] [CrossRef] [PubMed]
  48. Weir, C.B.; Jan, A. BMI Classification Percentile and Cut off Points; StatPearls Publishing: Treasure Island, FL, USA, 2021. [Google Scholar]
  49. Ferlay, J.; Soerjomataram, I.; Dikshit, R.; Eser, S.; Mathers, C.; Rebelo, M.; Parkin, D.M.; Forman, D.; Bray, F. Cancer Incidence and Mortality Worldwide: Sources, Methods and Major Patterns in GLOBOCAN 2012. Int. J. Cancer 2015, 136, E359–E386. [Google Scholar] [CrossRef] [PubMed]
  50. Abedi, S.; Janbabaei, G.; Afshari, M.; Moosazadeh, M.; Rashidi Alashti, M.; Hedayatizadeh-Omran, A.; Alizadeh-Navaei, R.; Abedini, E. Estimating the Survival of Patients with Lung Cancer: What Is the Best Statistical Model? J. Prev. Med. Public Health 2019, 52, 140–144. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Shen, H.S.; Wen, S.H. Effect of Early Use of Chinese Herbal Products on Mortality Rate in Patients with Lung Cancer. J. Ethnopharmacol. 2018, 211, 1–8. [Google Scholar] [CrossRef]
  52. Amini, P.; Abazari, M.; Alafchi, B. Detecting Important Risk Factors of Survival Time of Lung Cancer Patients Using Censored Quintile Regression. Asian Pac. J. Cancer Prev. 2019, 20, 2583–2588. [Google Scholar]
  53. The ATBC Cancer Prevention Study Group. The Alpha-Tocopherol, Beta-Carotene Lung Cancer Prevention Study: Design, Methods, Participant Characteristics, and Compliance. Ann. Epidemiol. 1994, 4, 1–10. [Google Scholar] [CrossRef]
  54. Hennekens, C.H.; Buring, J.E.; Manson, J.E.; Stampfer, M.; Rosner, B.; Cook, N.R.; Belanger, C.; LaMotte, F.; Gaziano, J.M.; Ridker, P.M.; et al. Lack of Effect of Long-Term Supplementation with Beta Carotene on the Incidence of Malignant Neoplasms and Cardiovascular Disease. N. Engl. J. Med. 1996, 334, 1145–1149. [Google Scholar] [CrossRef] [Green Version]
  55. Fold, N.R.; Allison, M.R.; Wood, C.B.; Thao, P.T.B.; Bonnet, S.; Garivait, S.; Kamens, R.; Pengjan, S. An Assessment of Annual Mortality Attributable to Ambient PM2.5 in Bangkok, Thailand. Int. J. Environ. Res. Public Health 2020, 17, 7298. [Google Scholar] [CrossRef]
  56. Cakmak, S.; Hebbern, C.A.; Pinault, L.L.; Lavigne, É.; Vanos, J.K.; Crouse, D.L.; Tjepkema, M. Associations between long-term PM2.5 and ozone exposure and mortality in the Canadian Census Health and Environment Cohort (CANCHEC), by spatial synoptic classification zone. Environ. Int. 2018, 111, 200–211. [Google Scholar] [CrossRef]
  57. Sarnat, J.A.; Schwartz, J.; Suh, H.H.; Samet, J.M.; Dominici, F.; Zeger, S.L. Fine Particulate Air Pollution and Mortality in 20 U.S. Cities. N. Engl. J. Med. 2001, 344, 1253–1254. [Google Scholar]
  58. Pope, C.A., III; Burnett, R.T.; Thun, M.J.; Calle, E.E.; Krewski, D.; Ito, K.; Thurston, G.D. Lung Cancer, Cardiopulmonary Mortality, and Long-Term Exposure to Fine Particulate Air Pollution. JAMA 2002, 287, 1132–1141. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  59. Liao, W.B.; Ju, K.; Zhou, Q.; Gao, Y.M.; Pan, J. Forecasting PM2.5-Induced Lung Cancer Mortality and Morbidity at County Level in China Using Satellite-Derived PM2.5 Data from 1998 to 2016: A Modeling Study. Environ. Sci. Pollut. Res. 2020, 27, 22946–22955. [Google Scholar] [CrossRef] [PubMed]
  60. Office for National Statistics. Cancer Survival by Stage at Diagnosis for England; Office for National Statistics: London, UK, 2019. [Google Scholar]
  61. Nikam, J.; Archer, D.; Nopsert, C. Air Quality in Thailand: Understanding the Regulatory Context; SEI Working Paper; Environment Institute: Stockholm, Sweden, 2021. [Google Scholar]
  62. Jenwitheesuk, K.; Peansukwech, U.; Jenwitheesuk, K. Accumulated Ambient Air Pollution and Colon Cancer Incidence in Thailand. Sci. Rep. 2020, 10, 17765. [Google Scholar] [CrossRef] [PubMed]
  63. Azur, M.J.; Stuart, E.A.; Frangakis, C.; Leaf, P.J. Multiple imputation by chained equations: What is it and how does it work? Int. J. Methods Psychiatr. Res. 2011, 20, 40–49. [Google Scholar] [CrossRef] [PubMed]
Ijerph 19 04521 g001 550
Figure 1. Land use map of 8 provinces in northern Thailand.
Figure 1. Land use map of 8 provinces in northern Thailand.
Ijerph 19 04521 g001
Ijerph 19 04521 g002 550
Figure 2. The survival rates of the lung cancer patients. Number at risk represents the number of patients who survived at each time point from diagnosis. Number of deaths represents the number of patients who died during the period between a previous time point to a specific time point.
Figure 2. The survival rates of the lung cancer patients. Number at risk represents the number of patients who survived at each time point from diagnosis. Number of deaths represents the number of patients who died during the period between a previous time point to a specific time point.
Ijerph 19 04521 g002
Ijerph 19 04521 g003 550
Figure 3. The survival rates of lung cancer patients according to gender.
Figure 3. The survival rates of lung cancer patients according to gender.
Ijerph 19 04521 g003
Ijerph 19 04521 g004 550
Figure 4. The survival rates of the lung cancer patients according to the annually averaged PM2.5 concentration.
Figure 4. The survival rates of the lung cancer patients according to the annually averaged PM2.5 concentration.
Ijerph 19 04521 g004
Ijerph 19 04521 g005 550
Figure 5. The survival rates of lung cancer patients according to the annually averaged PM10 concentration.
Figure 5. The survival rates of lung cancer patients according to the annually averaged PM10 concentration.
Ijerph 19 04521 g005
Table
Table 1. Baseline characteristics of the study population and mortality rate.
Table 1. Baseline characteristics of the study population and mortality rate.
CharacteristicSurvived (n (%))Died (n (%))PYFUMortality Rate *95% CI
Overall650 (7%)9170 (93%)13,45168.266.8–69.6
Gender
Male358 (6%)5534 (94%)770571.870.0–73.7
Female292 (7%)3636 (93%)574663.361.3–65.4
Age at diagnosis (years)
<60 years295 (8%)3355 (92%)595356.454.5–58.3
>=60 years355 (6%)5815 (94%)749877.675.6–79.6
BMI (kg/m2)/5243
<18.5 kg/m273 (5%)1401 (95%)180277.873.8–81.9
>=18.5 kg/m2379 (12%)2724 (88%)583346.745.0–48.5
Cancer stage/257
Localized288 (15%)1681 (85%)489334.432.7–36.0
Regional152 (8%)1645 (92%)287757.254.5–60.0
Metastasized174 (3%)5623 (97%)5205108.0105.2–110.9
Smoking history/1990
Yes349 (6%)5788 (94%)785973.671.8–75.6
No198 (12%)1495 (88%)298850.047.6–52.6
Alcohol-use history/3285
Yes238 (7%)3346 (93%)481769.567.2–71.9
No258 (9%)2693 (91%)433162.259.9–64.6
Calendar year of enrollment
2003–2010205 (3%)4917 (97%)741366.364.5–68.2
2011–2018445 (9%)4253 (91%)603870.468.3–72.6
* per 100 PYFU (person years of follow-up). CI, confidence interval; BMI, body mass index.
Table
Table 2. Risk factors associated with death among the lung cancer patients.
Table 2. Risk factors associated with death among the lung cancer patients.
CharacteristicUnivariate AnalysisMultivariate Analysis
DeathsTotalHR95%CIp-Value *aHR95%CIp-Value *
At diagnosis
Male553458921.131.08–1.18<0.0011.171.11–1.22<0.001
Age ≥ 60 years581561701.211.16–1.26<0.0011.281.22–1.33<0.001
BMI < 18.5 kg/m2140114741.481.39–1.58<0.001---
Regional cancer stage164517971.251.17–1.34-1.321.23–1.41-
Metastatic cancer stage562357971.971.86–2.08<0.0012.132.01–2.25<0.001
Smoking history578861371.391.32–1.48<0.001---
Alcohol-use history334635841.121.06–1.18<0.001---
Enrolled between 2003 and 2010491751221.191.14–1.24<0.0011.301.24–1.36<0.001
Time-updated variables
Residential concentration of PM2.5 ≥ 40 (µg/m3)--1.081.03–1.130.0011.061.01–1.110.018
Residential concentration of PM10 ≥ 55 (µg/m3)--1.081.03–1.130.001---
Residential concentration of NO2 ≥ 8.7 ppb--1.010.97–1.060.543---
Residential concentration of O3 ≥ 37.8 ppb--0.990.95–1.040.782---
* p-value from partial likelihood ratio test. HR, hazard ratio; aHR, adjusted hazard ratio.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Nakharutai, N.; Traisathit, P.; Thongsak, N.; Supasri, T.; Srikummoon, P.; Thumronglaohapun, S.; Hemwan, P.; Chitapanarux, I. Impact of Residential Concentration of PM2.5 Analyzed as Time-Varying Covariate on the Survival Rate of Lung Cancer Patients: A 15-Year Hospital-Based Study in Upper Northern Thailand. Int. J. Environ. Res. Public Health 2022, 19, 4521. https://doi.org/10.3390/ijerph19084521

AMA Style

Nakharutai N, Traisathit P, Thongsak N, Supasri T, Srikummoon P, Thumronglaohapun S, Hemwan P, Chitapanarux I. Impact of Residential Concentration of PM2.5 Analyzed as Time-Varying Covariate on the Survival Rate of Lung Cancer Patients: A 15-Year Hospital-Based Study in Upper Northern Thailand. International Journal of Environmental Research and Public Health. 2022; 19(8):4521. https://doi.org/10.3390/ijerph19084521

Chicago/Turabian Style

Nakharutai, Nawapon, Patrinee Traisathit, Natthapat Thongsak, Titaporn Supasri, Pimwarat Srikummoon, Salinee Thumronglaohapun, Phonpat Hemwan, and Imjai Chitapanarux. 2022. "Impact of Residential Concentration of PM2.5 Analyzed as Time-Varying Covariate on the Survival Rate of Lung Cancer Patients: A 15-Year Hospital-Based Study in Upper Northern Thailand" International Journal of Environmental Research and Public Health 19, no. 8: 4521. https://doi.org/10.3390/ijerph19084521

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop