Abstract

Objective. Chinese patent medicine (CPM) has been widely used to treat eczema in mainland China for decades. This study aims to investigate circulating CPM for eczema in mainland China and to evaluate the reporting quality of randomized controlled trials (RCTs) of them by using the CONSORT-CHM formulas 2017 (Consolidated Standards of Reporting Trials for Chinese herbal medicine formulas 2017). Methods. Circulating CPM with the indication for eczema was selected by searching three drug databases and confirmed by contacting the manufacturers. RCTs for the treatment of eczema with CPM were selected in four Chinese literature databases and four English literature databases from their inception to August 31, 2019. The reporting quality of included RCTs was assessed based on the CONSORT-CHM formulas 2017. A univariate analysis was conducted to identify the factors associated with the reporting quality. Results. A total of 70 circulating CPMs had the indication for eczema. Among them, 21 CPMs with 144 RCTs reached the eligible criteria. The mean overall quality score (OQS) of 144 RCTs was 19.85 ± 2.73, which was much less than the maximum score of 38. Of the 38 items, 12 items were reported in over 70% of the trials, 6 items were reported in 50%–70% of the trials, and 16 items were reported in less than 50% of the trials. Publication after 2015 () and the first author from a university hospital () were associated with the better reporting quality. Conclusion. There are a lot of circulating CPMs with the indication for eczema in mainland China, but both the quantity and the reporting quality of RCTs regarding those CPMs are suboptimal. It is necessary that authors and journal editors learn and adhere to the CONSORT-CHM formulas 2017 to enhance the reporting quality of RCTs for the treatment of eczema with CPM.

1. Introduction

Traditional Chinese medicine (TCM), including Chinese herbal medicine (CHM), acupuncture, cupping, and massage, plays an important role in the Chinese health care system, and almost all hospitals in China provide TCM services. Patients around the world also benefit from TCM extract, such as artemisinin, an antimalarial drug [1]. As an important part of CHM, Chinese patent medicine (CPM) is a production of a fixed formula of TCM processed in accordance with the prescribed prescriptions and standards and approved by China National Medical Products Administration (NMPA) [2]. Eczema is a common chronic, inflammatory skin disease, which presents as redness, scaling, swelling, and skin thickening. There is wide variation in the prevalence of eczema over the world. It is reported that 9.5% of children and 10.2% of adults are affected by eczema in the United States [3, 4]. In China, the prevalence of childhood eczema ranges from 11.8% to 18.71% [5, 6]. Compared with western medicine, such as topical corticosteroids and oral corticosteroids, CPM preparations are compound and could treat eczema through multiple mechanisms. In addition, there is no need to worry about adverse effects of glucocorticoids. Owing to these advantages, CPM has been widely used for eczema in mainland China for decades. Some studies have showed that CPM has good effects on alleviating pruritus and reducing skin lesions [7, 8]. However, there is no current investigation evaluating the reporting quality of these studies.

The randomized controlled trials (RCTs), providing the evidence of efficacy and safety of interventions, are fundamental to generate evidence-based practice guidelines. However, a reader cannot accurately evaluate the conclusion if a clinical trial is not reported with sufficient details. To standardize and improve the reporting quality of RCTs, the CONSORT (Consolidated Standards of Reporting Trials) statement was published in 1996 and updated in 2010 by the CONSORT group [9, 10]. It provides authors with a minimum set of recommendations for reports. The CONSORT statement has substantially improved the reporting quality of RCTs, including dermatology RCTs [11, 12]. The CONSORT-CHM formulas 2017 (Consolidated Standards of Reporting Trials for Chinese herbal medicine formulas 2017), a special extension for the CONSORT statement, has been developed in 2017 to guide the reporting of RCTs using CHM formulas [13].

To the best of our knowledge, the number of CPMs for eczema and the reporting quality of RCTs for the treatment of eczema with CPM in mainland China have not been investigated yet. The aims of this study are to search the circulating CPMs with the indication for eczema in mainland China and to evaluate the reporting quality of RCTs regarding these products by using the CONSORT-CHM formulas 2017.

2. Methods

This study consisted of three parts. First, circulating CPM with the indication for eczema in mainland China was selected by searching drug databases and confirmed by contacting the manufacturers. Second, RCTs of each eligible CPM were selected by retrieving literature databases. Third, the reporting quality of each included RCT was assessed based on the CONSORT-CHM formulas 2017.

2.1. Databases, Search Strategy, and Eligibility of CPM

By using the search terms “eczema” and “dermatitis,” CPM was collected from the following three drug databases: Sanjiu Yaopintong (https://ypk.39.net), Yaozhi database (https://db.yaozh.com/), and China NMPA (https://www.nmpa.gov.cn). CPM was included if it had the indication for eczema and drug approval number from China NMPA. CPM containing western medicine or out of circulation on the market was excluded.

2.2. Databases, Search Strategy, and Eligibility of RCTs

Four Chinese literature databases and four English literature databases were used to search relevant articles from their inception to August 31, 2019, including Chinese National Knowledge Infrastructure database (CNKI), Wanfang Data knowledge service platform (Wanfang), Chongqing Weipu database (VIP), Chinese Biomedical Literature database (SinoMed), PubMed, Cochrane Library, Embase, and Web of Science. The search strategy used for each database was ((“eczema” [Mesh] OR “eczema” [Title/Abstract]) OR (“dermatitis” [Mesh] OR “dermatitis” [Title/Abstract])) AND (“the name of each CPM” [Title/Abstract]). Inclusion criteria were as follows: RCTs published in Chinese or English; participants diagnosed as eczema, regardless of gender, age, or duration of eczema; the experimental group treated with CPM alone or CPM combined with western medicine same as the control group; and the control group treated with placebo or western medicine. Reviews, animal experiments, case reports, non-RCTs, duplicate studies, unavailable full texts, and studies with inappropriate interventions were excluded.

2.3. Data Extraction and Assessment of Reporting Quality

The following information from included RCTs was extracted: year of publication, language of the study, number of research center, sample size, and the type of the first author’s hospital. The reporting quality was assessed by using the CONSORT-CHM formulas 2017, comprising a checklist of 38 items [13]. The full version of the CONSORT-CHM formulas 2017 is provided in Supplementary Table 1. Each item was given a “Yes, No, or Not applicable” response depending on the level of reporting of each RCT. In addition, to calculate the quality score of each RCT, “Yes” or “Not applicable” was scored 1 and “No” was scored 0. The overall quality score (OQS) of each RCT was calculated by adding together the score of each item and could vary between 0 and 38.

All procedures of CPM search, RCT search, data extraction, and assessment of reporting quality were carried out by two authors (ML and BYZ) independently, and discrepancies were resolved by consultation from the third author (LHZ).

2.4. Statistical Analysis

The primary outcomes were the number of circulating CPMs with the indication for eczema in mainland China and the mean OQS of included RCTs in accordance with the CONSORT-CHM formulas 2017. The secondary outcomes were the reporting rate of each item of the CONSORT-CHM formulas 2017 and the associations between the reporting quality and the following factors: year of publication and the type of the first author’s hospital.

Continuous variables were presented as mean ± standard deviation (SD), and the independent sample t-test was used for comparison of continuous variables. Categorical variables were presented as rates, and comparison of categorical variables was performed by the chi-squared test. Mean differences (MDs) and their 95% confidence intervals (CIs) were calculated to illustrate differences in the OQS. Odds ratios (ORs) and their 95% CIs were calculated to illustrate differences in the reporting rate of each item. SPSS 22.0 software (SPSS Inc., Chicago, IL, USA) was used for data analysis, and was considered statistically significant.

3. Results

3.1. Search Results of CPM for Eczema and Related RCTs

After removing the duplicates, 136 CPMs were selected from three drug databases. Of those, 46 CPMs without the indication for eczema, 4 CPMs without drug approval number from China NMPA, and 16 CPMs containing western medicine were excluded. Finally, 70 CPMs, including 37 topical CPMs and 33 oral CPMs, met the eligible criteria. The list of 70 included CPMs is summarized in Supplementary Table 2.

In total, 1733 articles were retrieved from four Chinese literature databases and four English literature databases. 1479 articles were excluded as a result of checking titles and abstracts. After screening full texts, 110 articles were excluded. 144 eligible RCTs which involved 21 CPMs were included in the final analysis. 11 out of 21 CPMs (52.38%) had no more than two eligible RCTs. Figure 1 shows the flowchart of RCTs selection. Table 1 provides the list of 21 included CPMs and the number of eligible RCTs of each CPM. The list of 144 included RCTs is shown in Supplementary File 1.

3.2. Characteristics of Included RCTs

All included RCTs were conducted by authors from mainland China. The 144 studies were published from 1996 to 2019, and 50 (34.72%) of them were published in recent five years. Only one article (0.69%) was printed in English in an international journal, and the remaining 143 articles were printed in Chinese in Chinese journals. Except for four multiple-center RCTs, most (97.22%, n = 140) were conducted at a single center. The mean sample size of all studies was 102.67 ± 49.25, ranging from 42 to 426. The first author was from a university hospital in 73 studies (50.69%). Table 2 provides the general characteristics of 144 included RCTs. The detailed information about each included RCT, such as first author, sample size, interventions, and outcomes, is summarized in Supplementary Table 3.

3.3. Reporting Quality of Included RCTs

In the 144 RCTs, the mean OQS was 19.85 ± 2.73, ranging from 13 to 32. Three studies (2.08%) scored 27 or more, the OQS of 106 studies (73.61%) varied between 19 and 26, and 35 studies (24.31%) scored 18 or less. The distribution of OQS of 144 RCTs is shown in Table 3.

In the subgroup of 38 items, 12 items (3a, 4b, 5, 6a, 12a, 13a, 13b, 14a, 16, 18, 19, and 22) were reported in over 70% of the RCTs, and 6 items (1b, 2a, 4a, 11b, 12b, and 21) were stated in 50%–70% of the RCTs. Reporting rates were less than 50% for 16 items (1a, 1c, 2b, 7a, 8a, 8b, 9, 10, 11a, 15, 17a, 17b, 20, 23, 24, and 25). Among them, 2 items (17a and 17b) were not mentioned at all. In addition, 4 items (3b, 6b, 7b, and 14b) were not applicable in all studies. In the 144 studies, six studies (4.17%) adopted the blinding methods, including four double-blinded studies, one evaluator-blinded study, and one single-blinded study with an uncertain blinded object. Six studies (4.17%) adopted subgroup analysis to evaluate the effect of CPM for different stages of eczema or participants with different ages. Table 4 presents the reporting number and percentage for each item of the CONSORT-CHM formulas 2017. The score of each item for each RCT is provided in Supplementary Table 4.

3.4. Reporting Quality by Year of Publication

The mean OQS of studies published after 2015 was significantly higher than that of studies published before 2015 (21.28 ± 2.76 vs 19.10 ± 2.41, MD: 2.18, 95% CI: 1.31–3.06, ). According to the calculated ORs, the reporting rates of seven items were significantly higher in studies published after 2015: abstract (OR: 4.98, 95% CI: 1.93–12.83), background (OR: 8.90, 95% CI: 2.96–26.73), objectives (OR: 2.99, 95% CI: 1.36–6.55), methods used to generate the random allocation sequence (OR: 2.33, 95% CI: 1.06–5.12), statistical methods used to compare groups (OR: 4.17, 95% CI: 1.36–12.76), dates defining the periods of recruitment and follow-up (OR: 3.31, 95% CI: 1.07–10.25), and limitations (OR: 6.27, 95% CI: 1.22–32.34). Table 5 presents the reporting quality of each item by year of publication.

3.5. Reporting Quality by the Type of the First Author’s Hospital

The mean OQS of studies with the first author from a university hospital was significantly higher than that of studies with the first author from a nonuniversity hospital (20.42 ± 3.16 vs 19.27 ± 2.08, MD: 1.16, 95% CI: 0.28–2.04, ). The reporting rates of four items were significantly higher in the studies with the first author from a university hospital: objectives (OR: 2.67, 95% CI: 1.19–5.99), dates defining the periods of recruitment and follow-up (OR: 4.08, 95% CI: 1.52–10.95), baseline data, and funding. However, the reporting rate of abstract was lower in studies with the first author from a university hospital (OR: 0.47, 95% CI: 0.23–0.97). Table 5 presents the reporting quality of each item by the type of the first author’s hospital.

4. Discussion

In this study, we first summarized the number of circulating CPM with the indication for eczema in mainland China. Because most RCTs in mainland China did not have “TCM” or “CPM” in title, abstract, or keyword, we decided to search eligible CPM before retrieving literatures, rather than searching literature directly by using search terms “TCM” and “CPM.” As the result showed, 70 circulating CPMs had the indication for eczema in mainland China, and more than a third of eligible RCTs were published in recent five years, which demonstrated the wide application of CPM for eczema in mainland China. However, only 30% of included CPMs had the eligible RCTs, and 10 out of 21 CPMs had more than two eligible RCTs. The low proportions indicated that more efforts were needed to enhance the clinical evidence of CPM for eczema.

We also investigated the reporting quality of RCTs for the treatment of eczema with CPM by using the CONSORT-CHM formulas 2017, which added one item of “keywords” on the basis of the CONSORT statement. Our results showed that the mean OQS of 144 included RCTs was 19.85, only 52.24% of the maximum score (19.85/38), and few trials scored more than 70% of the maximum score. Similarly, a study on RCTs of TCM for diabetes mellitus in three top TCM journals showed that the total reporting rate of the CONSORT statement was only 45.0% [14]. On the other hand, only 12 items had an optimal reporting rate (reported in over 70% of trials) in our study. Some studies on RCTs of TCM treatments hold the same results, and the number of items with an optimal reporting rate ranged from 10 to 16 [1517]. In summary, most included RCTs in this study did not strictly comply with the CONSORT-CHM formulas 2017, and the reporting quality of 144 RCTs was suboptimal. Low reporting quality could not only affect other researchers to understand the conclusion of a study but also increase the risk of bias of a systematic review and lower the level of clinical evidence. Therefore, authors and journal editors need to learn the items of the CONSORT-CHM formulas 2017 and apply it to article structures to improve the reporting quality.

The result showed that there were 16 items with a poor report rate (reported in below 50% of trials). Among them, some items are important and essential. When a trial has “randomized” or “RCT” in the title and keyword, it is easily retrieved and identified as a RCT. However, the proportions of two items were 2.78% and 3.47%, respectively, in this study. Other similar studies showed that 0.80%–5.9% of RCTs of TCM treatments mentioned randomization in the title [16, 18]. However, after applying the CONSORT statement, this proportion in a TCM journal was up to 100% [19].

Methodological items are pivotal elements for clinical trials. Sample size estimation can decrease the risk of false-negative results and obtain precise outcomes. The previous study showed that 50–200 subjects would need to be enrolled to reduce the risk of missing a true difference in cutaneous surgery therapeutic trials [20]. Although most included studies contained sixty or more patients, only one article (0.69%) described how sample size was determined. Similarly, this proportion was only 0.42% in 2861 RCTs of TCM treatments in CNKI database [18]. Instead, 52 out of 181 RCTs (28.73%) in the 44 international dermatology journals calculated the sample size [21]. In clinical trials, abundant participants may be a waste of time and money, while better results may not be achieved. Therefore, it needs a balance between statistics and expenses when considering the sample size of a trial.

Randomization is the major hallmark of a RCT. Its ultimate objectives are to create balanced treatment groups and to minimize the risk of biased results [22]. Inadequate randomization methods may exaggerate the estimate of the intervention effect [23]. In our study, 23.61% of the trials described sequence generation methods and 2.78% of the trials reported the types of randomization. Moreover, only one trial (0.69%) depicted allocation concealment and implementation. In many top TCM journals, the reporting rates of sequence generation methods were up to 47%–100%, whereas few RCTs reported allocation concealment and implementation [14, 17, 19]. Instead, international journals performed better in this respect. A review on 109 RCTs of eczema treatments in the Global Resource of Eczema Trials (GREAT) database from 2007 to 2011 found that 44 trials (40.37%) and 15 trials (13.76%) reported the randomization method and allocation concealment, respectively [24]. Among 141 RCTs in four top dermatology journals from 2015 to 2017, 70.21%, 58.16%, and 48.94% of the trials provided information on the methods of random sequence generation, allocation concealment, and implementation, respectively [12].

Blinding is considered as an essential component for internal validity of RCTs. It aims to prevent bias associated with expectations from patients, investigators, and assessors. Treatment effects may be overestimated or underestimated without blinding [25, 26]. Five trials (3.47%) in this study reported the blinding methods, and three of six trials (50%) described the similarities of interventions. Similarly, about 5% of RCTs of TCM treatments published in Chinese reported the blinding methods [14, 17], while this proportion increased to 30% in a TCM journal after the journal adopted the CONSORT statement [19]. In contrast, among 109 RCTs of eczema treatments in the GREAT database from 2007 to 2011, blinding was reported in 31.19% of the trials [24]. This percentage rose to 81.56% in 141 RCTs in four dermatology journals from 2015 to 2017, and 61.76% of the trials described the similarities of interventions [12].

Discrepancies between registered and published outcomes in clinical trials are common, which may make results attractive but also fake [27, 28]. Trial registrations and available protocols could provide some feasible solutions [29, 30]. There were one registered RCT (0.69%) and two RCTs (1.39%) with available protocols in this study. Almost RCTs of TCM treatments in TCM journals, regardless in Chinese or English, also lacked the information on these two items [18, 19]. On the contrary, 16.51% of 109 RCTs of eczema treatments in the GREAT database from 2007 to 2011 submitted the registration before the trial end date [24], and this proportion increased to 73.76% in 141 RCTs in four top dermatology journals from 2015 to 2017 [12]. Besides, funding source is an important part of a trial. It is more likely to report favorable outcomes for industry-sponsored studies [31]. In our study, only 6.25% of the trials reported the funding source, whereas nearly 70% of dermatology RCTs from PubMed database described the funding source [32].

In this study, some items had an optimal reporting rate, such as harms. The safety of a drug is as important as its effectiveness, and only safe treatments could be widely applied in clinical practice. In our study, 83.33% of the trials reported adverse events of CPM during the treatment. All adverse events were mild and tolerable, and no serious adverse events were observed. Analogously, harms were reported in 80 out of 110 RCTs (72.72%) in five top dermatology journals [33].

Like some previous studies [16, 18], our results showed that publication after 2015 was associated with the better reporting quality, representing as higher OQS and higher reporting rates of some important items, such as sequence generation methods and limitations. These findings demonstrated the efforts of authors in mainland China to improve the reporting quality. Another factor associated with the better reporting quality is the first author from a university hospital. In China, a university hospital, almost the top local hospital, has more advantages than a nonuniversity hospital in doctors’ quality, medical equipment, and funding. In this study, the higher reporting rate of funding was found in the studies with the first author from a university hospital. However, the lower reporting rate of abstract in them may be due to short articles. In our study, short articles with one page were common, and abstract was simplified or omitted.

There are some limitations in this study. First, only CPMs with the indication for eczema were included. In clinical practice, numerous CPMs without the indication for eczema are used to treat eczema, such as Runzao Zhiyang capsule [8]. It is better to have an additional summary of these off-label CPMs. Second, only patients treated with placebo and western medicine were considered to be the control groups. Because of the lack of high-quality clinical evidence, TCM is not recommended for eczema in many guidelines outside China; therefore, we exclude the RCTs which made comparison between CPM and TCM.

5. Conclusions

In conclusion, there are a large number of CPMs with the indication for eczema in mainland China; however, both the quantity and the reporting quality of RCTs regarding those CPMs are suboptimal. Therefore, more well-designed clinical trials are needed to enhance the level of evidence of CPM for eczema. Authors and journal editors are encouraged to learn and adhere to the CONSORT-CHM formulas 2017 to improve the reporting quality of the RCTs.

Data Availability

The data used to support the results of this study are included within the article and supplementary materials.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Authors’ Contributions

Ming Li and Linfeng Li conceptualized and designed the study. Ming Li, Boyang Zhou, and Lihong Zhou conducted the search of CPM and literatures, extracted the data, and assessed the reporting quality. Ming Li and Boyang Zhou performed statistical analysis. Ming Li wrote the manuscript. Linfeng Li revised the manuscript.

Supplementary Materials

Supplementary Table 1: checklist of items for the CONSORT-CHM formulas 2017. Supplementary Table 2: the list of Chinese patent medicine with the indication for eczema. Supplementary File 1: the list of 144 randomized controlled trials on Chinese patent medicine for eczema. Supplementary Table 3: the characteristics of 144 randomized controlled trials on Chinese patent medicine for eczema. Supplementary Table 4: the score of each item for 144 randomized controlled trials based on the CONSORT-CHM formulas 2017. (Supplementary Materials)