Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Mental health disorders research in the countries of the Organisation of Islamic Cooperation (OIC), 2008–17, and the disease burden: Bibliometric study

  • Grant Lewison ,

    Roles Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    grantlewison@aol.co.uk

    Affiliation Department of Cancer and Pharmaceutical Sciences, Institute of Cancer Policy, Guy’s Hospital, King’s College London, London, United Kingdom

  • Richard Sullivan,

    Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Validation, Writing – review & editing

    Affiliation Department of Cancer and Pharmaceutical Sciences, Institute of Cancer Policy, Guy’s Hospital, King’s College London, London, United Kingdom

  • Cengiz Kiliç

    Roles Validation, Writing – review & editing

    Affiliation Department of Psychiatry, and Stess Assessment and Research Centre (STAR), Hacettepe University, Ankara, Turkey

Abstract

The 57 countries of the Organisation of Islamic Cooperation are suffering from an increasing burden from mental health disorders. We investigated their research outputs during 2008–17 in the Web of Science in order to compare them with the burden from different mental health disorders and in different countries. The papers were identified with a complex filter based on title words and journals. Their addresses were parsed to give fractional country counts, show international collaboration, and also reveal country concentration on individual disorders and types of research. We found 17,920 papers in the decade, with output quadrupling. Foreign contributions accounted for 15% of addresses; they were from Europe (7%), Canada + USA (5%) and elsewhere (3%). They were much greater for Qatar and Uganda (> 60%), but less than 10% for Iran and Turkey. Schizophrenia and bipolar disorder were over-researched, but suicide and self-harm were seriously neglected, relative to their mental health disorder burdens. Although OIC research has been expanding rapidly, some countries have published little on this subject, perhaps because of stigma. Turkey collaborates relatively little internationally and as a result its papers received few citations. Among the large OIC countries, it has almost the highest relative mental health disorders burden, which is also growing rapidly.

1 Introduction

1.1 Objective

The purpose of this paper is to compare the burden of mental illness in the 57 countries of the Organisation of Islamic Coöperation (OIC) with the amount and distribution of their research to see if their portfolios are appropriate for the mental health disorder challenges that they face. The countries are listed in Table 1 with their International Standards Organization (ISO) digraph codes. Most of them are in the Middle East or North Africa (MENA) region. They vary greatly in size, from the wealthiest in terms of Gross Domestic Product (GDP): Indonesia (USD 862 billion in 2015), Turkey (USD 718 bn) and Saudi Arabia (USD 646 bn), down to Comoros and Gambia, with GDP < USD 1 bn. We also sought possible changes that they could make that would enable them better to rise to these challenges. In particular, we investigated the role of international collaboration in helping them to improve their research capability.

thumbnail
Table 1. List of the 57 countries in the Organisation of Islamic Co-operation group, with their ISO2 codes.

https://doi.org/10.1371/journal.pone.0250414.t001

1.2 Previous studies

There is an extensive literature on the bibliometrics of mental health disorders research. We found over 130 papers, of which more than 80 appeared since 2010. Most of them were about particular disorders, notably depression (19), suicide & self-harm (13), Alzheimer’s disease (11), and addiction and anxiety (10 each). We could find no previous bibliometric study of mental health in this particular political grouping, but mental health research in the 22 Arab countries in 2009–18 was investigated recently [1]. They found that the leading countries were Egypt, Saudi Arabia, and Lebanon, and that Arab output had expanded more rapidly than world production. Many of the OIC countries are in the lower middle and low income groups, and their mental health research outputs were examined by Large et al. [2]. They also found a rapid increase in output in the last decade. Recent bibliometric studies on individual mental health disorders have included ones on depression [35], suicide & self-harm [6, 7], Alzheimer’s disease [810] and addiction [1114]. Most of these papers described the growth in the world literature, or in individual countries or regions. Many of them employed a similar methodology to the one used here, namely a comparison of research outputs with the disease burden, or with individual countries’ wealth.

1.3 The burden of mental health disorders

In this paper, we have defined mental health disorders to include all those listed by the World Health Organization (WHO) within the category II E "Mental and substance use disorders", with the addition of "Alzheimer’s and other dementias" (whose symptoms are primarily mental), and under category III B, "Self harm" which includes suicide. However, we excluded those whose cause is primarily genetic ("Autism and Asperger syndrome", "Childhood behavioural disorders", and "Idiopathic intellectual disability"). [This was the definition adopted for a recent project to map five European non-communicable disease research outputs in 2002–13 for the European Union [15, 16]. It was intended to exclude those mental health disorders that are not readily treatable as a result of research.]

In the OIC countries, the burden from mental health has been increasing steadily. This is shown by the percentage of the disease burden calculated by the WHO, and measured by Disability-Adjusted Life Years (DALYs). These are the sum of years lost because of early death, and years lived with a disability of varying severity, in a country. However, many of the data are unlikely to be reliable, particularly for 16 of the OIC African countries, whose data are marked by the WHO as being in the least good category. Table 2 shows data for 2000 and 2015 for 11 of the OIC countries, the group as a whole, and for three other sets of countries as comparators: Canada and the USA; the 27 Member States of the European Union plus Iceland, Norway, Switzerland and the UK (EUR31); and the Rest of the World (RoW).

thumbnail
Table 2. Percentages of total DALYs from mental disorders in some OIC countries in 2000 and 2015, the ratio between them, and corresponding percentages for other country groups.

https://doi.org/10.1371/journal.pone.0250414.t002

The mental health disorders burden is clearly increasing globally, but rather more rapidly in the OIC countries than in the other three geographical groups. Within the OIC, two countries (Qatar and the United Arab Emirates (UAE)) now have a greater relative mental health disorders burden than the European average, and all the ones listed have a higher percentage burden than the mean for the Rest of the World. The prevalence of any psychiatric disorder in Turkey has generally been found to be lower than in western countries (although somewhat higher than in Asian countries), as was shown in a collaborative international study [17, 18]. More recent epidemiological studies in the OIC countries revealed 12-month prevalence rates that were higher than those of Turkey (13.6% in Iraq and 20.2% in Saudi Arabia) [19, 20]. Although their incidence was relatively low then, it has since grown more rapidly than in most other OIC countries (Table 2).

2 Methodology

2.1 Formation of the database

Articles and reviews were identified in the Web of Science (WoS) by means of a complex filter based on 184 named mental disorder journals such as:

  1. Addiction or Behavior Genetics or Cognitive Therapy and Research or Depression and Anxiety or Eating Disorders or Forum der Psychoanalyse

and 236 title words, or phrases, such as:

  1. addict* or bipolar or carbamazepine or dement* or eating-disorder* or frigidity or gambling or hysteria or inject-drugs

which included the names of disorders, and drugs and other measures used to treat them. There was also a negative search statement designed to exclude papers in non-relevant subject areas, such as:

  1. AGRONOMY or BUSINESS* or CLASSICS or DEMOGRAPHY or ECOLOGY or FISHERIES or GEO* or HISTORY*.

(This search strategy is reproduced in the S1 Appendix) Papers were selected if they had at least one address from an OIC country, see Table 1, and were published in the ten-year period, 2008–17. There was no language restriction. The filter was applied to the Science Citation Index-Expanded, the Social Sciences Citation Index, the Conference Proceedings Citation Index–Science and the Emerging Sciences Citation Index. The bibliographic details of the identified papers were downloaded to a series of text files, and then combined to form a single spreadsheet. [Individual inspection was used to remove non-relevant papers containing the words drug or drugs, and some containing the word alcohol which were concerned with the enhanced risks of cancer or with chemistry, respectively.] We calibrated the filter by marking samples of papers that it had identified as relevant, not relevant, or marginal [21], and determined the precision (specificity) as 0.74 and the recall (sensitivity) as 0.79. This meant that the true total of OIC papers was 0.74 / 0.79 = 0.94 times the apparent total.

We also compared the mental health disorders research outputs of the OIC countries with their overall biomedical research outputs in the same years. These were selected by means of a complex filter based on address terms [22], such as:

  1. AIDS or BETHESDA or CHILD* or DAIICHI or EPIDEM* or FAMILY

so as to show the percentage of their biomedical research papers that were about mental health disorders. This comparison was based on integer counts of countries.

2.2 Geographical and subject analysis, and comparison with mental health disorders burden

The addresses on the papers were parsed by means of a Visual Basic Applications (VBA) program to show the fractional counts of the countries. [For example, a paper with two Turkish addresses and one from France would be classed as TR = 0.67, FR = 0.33.] We are aware that this allocation of credit to different countries may well mis-state the relative importance of the several contributions, but there is really no practical alternative. There are some papers with large numbers of authors (and addresses) and it would seem unreasonable to give each country (or author) full credit for the whole paper.

We also applied two special filter programs to the papers’ titles and journal names in order to classify them by the mental health disorder(s) investigated by the authors, and by the type of research (e.g., genetics, drugs). These are listed, with the codes used in this paper, in Table 3. These outputs were cross-tabulated by the fractional counts of the leading OIC countries so as to show which ones were relatively specialising in particular subject areas. We also compared the OIC outputs on individual mental health disorders with the relative DALY burden from them in 2010.

thumbnail
Table 3. List of mental health disorders and research types (or domains) subject to analysis, and their trigraph and tetragraph codes.

https://doi.org/10.1371/journal.pone.0250414.t003

A further analysis was of the amount of research in health systems. Compared with the research on individual disorders, this is not an easily described subject area. We adopted this definition [23]:

A mental health system is defined as the structure and all the activities whose primary purpose is to promote, maintain or restore mental health. It includes all organizations and resources that focus on improving mental health, and it is commonly used as synonymous with mental health services.

We created two lists of paper title words: one of the systems being examined (e.g., burden, program, service), and the other their geographical or operational context (e.g, Egyptian, rural). Papers were selected from the main database if they had a title word from each of these two lists, or were in the International Journal of Mental Health Systems.

In order to put the research outputs of the different countries in context, they were plotted against the Gross Domestic Product (GDP) of the leading OIC states as this normally gives a good correlation, at least for rich research-active countries [24]. Because the outputs of the leading OIC states had been growing quite rapidly and because in 2015 the WoS was expanded to process many additional journals published out with North America and Western Europe, we used outputs in 2015–17, and compared them with GDP values for 2014. However, because the OIC countries varied greatly in the percentage of all DALYs attributable to mental disorders (as we defined them), we multiplied their GDP values by this percentage.

2.3 International collaboration

We also wished to see the amount of international collaboration in mental health disorders research by the OIC countries, and which third countries they favoured as partners. For this purpose, we calculated the fractional count contributions of the leading OIC countries to their papers, and the corresponding contributions by other OIC countries, by Canada + the USA, by the EUR31 countries, and by the Rest of the World. For the individual non-OIC countries, we counted their integer tallies as a percentage of the total of the OIC papers with non-OIC contributions, and compared this with the percentage presence of each country in mental health disorders research, after excluding OIC papers, for each of two five-year periods, 2008–12 and 2013–17. [For example, in 2013–17, there were 780 British contributions to the total of 3326 papers that had contributions by non-OIC co-authors, or 23.45%, but the British presence in mental health disorders research in these years was 11.6%, so evidently the UK was preferred as a partner by a factor of 23.45/11.6 = 2.02. Many other countries would have been less preferred, with a factor of less than unity, for example China, with a factor of 6.73%/7.13% = 0.94 in these five years.]

2.4 Citation counts

There are two commonly-used measures of the influence of research papers. One is the importance of the journal in which they are published, as measured by the Clarivate Journal Impact Factor (JIF). We tabulated the mean JIF for the papers from 16 leading OIC countries, both for all their papers, and for their domestic ones (i.e., without international collaboration). [This gives a fairer estimate of the work of the local researchers in each country.] The second measure is the number of citations received from WoS journals, represented by the five-year citation scores (Actual Citation Impact, ACI) for the papers from the six years, 2008–13. These were determined from the WoS and copied and pasted to the file of papers. The citation counts were multiplied by the fractional contributions of each country to each paper, and then averaged. The mean value was also determined for domestic-only papers from each country.

The papers were also ranked by their ACI values, and the top 1% and 5% identified; they were cited respectively 59 and 26 times or more. (There were 386 papers with 26 citations or more, which is 386/7342 = 5.26%). The percentages of each country’s citable papers that received these numbers of citations or more were then calculated as percentages, divided by the average for the OIC of 1.01% or 5.26%, and then multiplied by 100 to give a "world scale" value [25]. This gives an alternative ranking of the OIC countries, although this is usually similar to that based on mean ACI values. We thus determined six separate indicators of the papers’ influence, and the countries were then ranked on each one, and ordered in the table by the mean value of these rankings.

3 Results

3.1 Outputs overall and by country

In the decade, 2008–17, there were a total of 17,920 papers in our database, and the total OIC fractional contribution was 15,170 papers. The difference of 2750 papers represented the contributions of other countries (15% of the total). The output grew at an annual rate of 14%, which is very high compared with that of the world in the same period (6.4%) or that of the USA (4.6%). There was a jump in output in 2015 when the Emerging Sciences Citation Index was established. It led to an increase in the numbers of OIC countries whose journals were covered in the WoS from ten to 18.

In the same ten-year period, the OIC countries published 478,038 biomedical research papers, which was 7% of the world total. Their mental health disorders output equalled 3.7% of their biomedical research output. However, the precision of the filter (p = 0.74) was lower than its recall (r = 0.79), so that the corrected total was only 3.5%. This compares with the disease burden of about 4.7% in those years.

Table 4 shows the fractional outputs of all the OIC countries, and the growth rate for the leading ten. [Six countries had no output during the decade.] Some countries, notably Malaysia, Jordan, Saudi Arabia and Iran, had outputs that grew at over 20% per year, but that of Kuwait actually declined over the decade (from 9.4 per year in 2008–10 to 5.7 per year in 2015–17).

thumbnail
Table 4. Outputs of mental health disorders research papers in the WoS, 2008–17, from the OIC countries, fractional counts, (for ISO codes, see Table 1).

https://doi.org/10.1371/journal.pone.0250414.t004

The outputs of the 24 leading OIC countries in 2015–17 are plotted against their GDP in 2014, multiplied by the percentage of all DALYs in 2015 that are attributable to mental health disorders, in Fig 1. Although there is clearly a positive correlation, the spots for the countries are in two main groups, with eight countries publishing much more than expected, notably Pakistan (PK), Iran (IR) and Turkey (TR), and ten of the others, much less. Among these are some of the richest countries, with a high mental health disorders toll, such as Qatar (QA), United Arab Emirates (AE), Kuwait (KW) and Bahrain (BH), which are clearly not doing enough relevant research.

thumbnail
Fig 1. OIC country outputs of mental disorders papers, 2015–17 compared with their wealth multiplied by the percentage of all DALYs in 2015 from mental disorders.

https://doi.org/10.1371/journal.pone.0250414.g001

3.2 International collaboration

Fig 2 shows the contributions of other countries, divided into three groups (Canada + the USA; the EUR31 countries; and the Rest of the World) to the OIC papers. The amount of collaboration with "third" countries has not increased much over time, especially with Canada and the USA. However, it is much higher for some of the OIC countries, see Fig 3, but much lower for Turkey (TR) and Iran (IR).

thumbnail
Fig 2. The contributions of non-OIC countries to WoS OIC mental disorders research papers, 2008–17.

https://doi.org/10.1371/journal.pone.0250414.g002

thumbnail
Fig 3. Collaboration in OIC mental disorders research with others in the OIC, Canada + USA, EUR31, and the Rest of the World (RoW).

https://doi.org/10.1371/journal.pone.0250414.g003

Table 5 shows the amount of collaboration between the OIC countries and other individual countries in two periods, and whether they are preferred, or non-preferred, as partners. Some of the cells are tinted to show where the ratios differ significantly from unity. For some of these countries these ratios have been increasing, but there are many exceptions, and China and South Korea have become less preferred as partners in the period 2013–17. Although most European countries are preferred as partners, the three most-preferred partner countries are all non-European, and are from different continents: South Africa (ZA), India (IN) and Mexico (MX).

thumbnail
Table 5. Collaboration in mental health disorders research between the OIC countries as a group with individual third countries in two quinquennia, 2008–12 and 2013–17 and percentages of total non-OIC papers (1360 and 3326, respectively; % OIC), compared with the countries’ percentage presence in world mental health disorders research in the same years (WoS, %), and ratio between them, all integer counts.

https://doi.org/10.1371/journal.pone.0250414.t005

3.3 Distribution of papers among mental health disorders and research domains

Fig 4 shows the distribution of papers among the leading mental health disorders in 2008–17 compared with the burden of disease from these different disorders in 2010. In this figure, the percentages of research in each of the nine disorders have been scaled up so that their sum equals 100% of the total. The diagonal line shows equivalence, and the dashed lines show where research outputs are twice, or half, the amount that would represent equivalence. Depression (DEP) is clearly the main disorder both in terms of research and disease burden, and the amount of research appears to be appropriate. However suicide and self harm (SUI) seems to be under-researched by a factor of three, whereas schizophrenia (SCH) and bipolar disorder (BIP) appear to attract about twice as much attention from OIC researchers as their disease burden would warrant.

thumbnail
Fig 4. OIC mental disorders research outputs, 2008–17, compared with their mental disorders percentage burden in DALYs.

https://doi.org/10.1371/journal.pone.0250414.g004

The relative commitment of the leading 16 OIC countries to research on the different mental health disorders is shown in Table 6. Many of the cells are tinted to show values notably above (green and light green) or below (yellow and pink) unity. Depression (DEP), the main subject for research, is actively researched by Pakistan (PK) and Uganda (UG). Because alcohol is prohibited or discouraged in many Muslim countries, there is a big disparity in the amount of research that it attracts. It is very high in Uganda, the United Arab Emirates (AE) and Lebanon (LB), but very low in Kuwait (KW), Morocco (MA), Qatar (QA), Jordan (JO) and Tunisia (TN).

thumbnail
Table 6. The relative commitment to research on each of nine mental health disorders by the 16 leading OIC countries, fractional counts.

https://doi.org/10.1371/journal.pone.0250414.t006

Table 7 shows the relative commitments of the leading 16 countries to research in the different domains listed in Table 3. Drug treatment (DRUG) is by far the most popular type of research and is actively supported in Egypt (EG) and Iran (IR). The latter, and Turkey (TR), are also active in non-pharmaceutical treatments (TREA), whereas research on these is almost ignored in most of the other OIC countries, and the combined OIC output is only 3.7% of the total compared with 5.8% in Europe [16]. Epidemiology (EPID) is researched fairly equally in all the countries listed here, but five of them do noticeably more than expected (Indonesia, ID; Lebanon, LB; Uganda, UG; Tunisia, TN and Malaysia, MY). Genetics only represents 6.3% of the total, much lower than in Europe (16%) [16]. Papers on health services research (n = 526) represented 2.8% of the total. This is much higher than their presence in world mental health disorders papers (0.95%). The countries most involved were Iran (81), Nigeria (69.7), and Turkey (42.8 papers).

thumbnail
Table 7. Relative commitment within mental health disorders research to work on six research types (codes in Table 3) by the leading 16 countries (codes in Table 1), 2008–17, fractional counts.

https://doi.org/10.1371/journal.pone.0250414.t007

3.4 The citation performance of the OIC countries

The last analysis is of the journal impact factors of all the papers, and of the citations to their 2008–13 papers, for the 16 leading OIC countries. The results are presented in Table 8, with the countries ranked by the mean of the six rankings. The best-performing country is Lebanon, followed by Uganda. Both countries collaborate extensively internationally (see Fig 3), and this has contributed to their higher scores on JIF and ACI for all their papers than for their domestic ones. However, in terms of domestic-only papers, Egypt is ranked highest on both indicators. It is notable that the performance of Iran (IR) is substantially better than that of Turkey, on all six indicators, although both countries collaborate internationally very little, see Fig 3.

thumbnail
Table 8. Journal Impact Factors for all and domestic mental health disorders research papers from 16 leading OIC countries; also citation performance (five-year counts, fractional country counts) (ACI all and ACI dom), and presence in the top 1% and 5% (59, 26 cites or more) showing World-Scale (W.S.) values (relative to norm of 100).

https://doi.org/10.1371/journal.pone.0250414.t008

4 Discussion

4.1 Outputs of the countries

The 57 OIC countries are increasing their outputs of mental health disorders research papers quite rapidly. From 2008 to 2017, their output grew at 14.4% per annum compared with 6.4% for the world total. This shows their appreciation of the growing burden of mental health disorders for their respective populations, which accounted for 5% of their total health burden in 2015, having increased from just 3.5% in 2000. However, many of the OIC countries in the Middle East region suffered much more from mental health disorders, particularly Qatar (QA) and the United Arab Emirates (AE) whose burden in DALYs was greater than 16% in 2015. The oil-rich countries–Saudi Arabia (SA), UAE, Qatar, Kuwait (KW), Iraq (IQ), and Nigeria (NG)–are the OIC countries with the highest relative burden from mental health disorders (Table 2), so really need to do more to build their research capacity and capability in mental health.

4.2 International collaboration

There is also a wide variation in the tendency of the OIC countries to collaborate internationally (Fig 3). This is a prime pre-condition for a country to be able to take part in high-level, internationally-impactful research. Some, such as Uganda (UG), the UAE and Lebanon (LB) collaborate actively: this has also led to a better citation record (Table 8). Iran has found itself rather scientifically isolated because of the international sanctions in place [26, 27], but Turkey’s isolation from other countries in this research area, as well as in cancer [28] is less understandable. It may be due to the way psychiatric research is evaluated in the country, with counts of WoS papers being used to gain academic posts, without consideration of their clinical impact. Its poor citation record as a result suggests that new policies for international engagement of this now strongly research-active country may be necessary. The OIC group as a whole appear to favour partnerships with both European and other non-EU countries, except those in East Asia. [The generally high values of preference are largely because integer counting has been used, so that papers with several non-OIC countries among the addresses count for all of them.]

4.3 Comparison of research with the disease burden

The output of OIC mental health disorders papers, as a percentage of their biomedical research output (3.5%), was somewhat lower than their disease burden at about 5.0% of all DALYs. However, it was much closer than the corresponding results for either Canada and the USA (6.9% cf. 16.5%) or for the EUR31 countries (6.2% cf. 12.9%). This shows that the OIC countries are taking mental health seriously in terms of research, at least in comparison with North America and Europe, where it appears to be neglected [16].

The distribution of research by disorder correlates fairly well with the overall disease burden from individual disorders (Fig 4); r2 = 0.69. Depression is the main mental disorder and attracts the most research. The main exception is research into suicide and self-harm (SUI). The figure indicates that these countries are doing only about one third as much research as the burden would appear to justify. This may in part be because of social attitudes, so that it is stigmatised more than depression, and the fact that suicide is regarded as a sin by Islam. It may also be occasioned by the thought that not much can be done about it, but recent results show that well-designed programmes can make a difference to outcomes [2931]. The success of charitable organisations such as the Samaritans in the UK and Ireland also shows that practical help can be given by trained volunteers who listen on the telephone to people with suicidal thoughts.

It is also of note that alcohol abuse is apparently receiving an appropriate amount of attention at 3.9% of the total on an adjusted basis. This compares favourably with the situation in Europe, where research on alcohol misuse is grossly neglected [11]. It is relatively most strongly researched in Uganda (UG), the UAE (AE) and Lebanon (LB). The legal situation for the sale of alcohol in the OIC group varies, and it is prohibited to all persons in 11 of them, and to Muslims in four more. Average per caput annual consumption is only 3.0 litres of ethanol in the OIC states compared with 7.6 in others (WHO, 2010). Alcohol is drunk widely in Uganda (9.8 l/yr) and Lebanon (6.7 l/yr), and available with a licence in the UAE (4.3 l/yr). However, the disease burden in 2010 was quite small in Uganda (0.2%) and in Lebanon (0.13%) suggesting that this particular area of mental health research is being appropriately addressed by individual countries within the OIC group.

Eating disorders (which in Europe mainly involve anorexia and bulimia) have a rather low burden in OIC group countries, with only 0.03% of the total DALYs. This is even lower in the 22 sub-Saharan African countries (average 0.013%) where high body mass index is often seen as a sign of good health; it is relatively higher in the others (average 0.092%). However, it does appear that anorexia is by no means absent from girls in Nigeria [32] and from young people in Turkey [33].

Drug treatment of mental health is the one most researched in the OIC group countries (Table 7). There appears to be rather little interest in non-pharmaceutical treatments except in Turkey (n = 273 papers) and Iran (n = 193). The main treatments researched were Cognitive Behavioural Therapy (CBT, 152 papers) and Electroconvulsive Therapy (ECT, 134 papers). Other treatments were surgery (for sleep apnoea, bariatric weight loss and cosmetic reasons; 47 papers), counselling (46), transcranial stimulation (40), and music (16) and play (12) therapy. There were also nine papers on couple/family/sex therapy.

4.4 Citation performance of countries

Papers from the OIC group were not well cited compared with those from their main partners. The overall average value of ACI was 8.0 cites in five years, but for the Netherlands, in comparison, it was 21.8; for the UK, 19.6 and for India, 19.4 cites. Lebanon (LB) and Uganda (UG) achieved the best performance among the OIC group (Table 8). This is likely to be because both countries collaborated extensively with Canada and the USA, and with the EUR31 countries (Fig 3), and were dominated by a few individuals. For example, of Uganda’s 92 citable papers (from 2008–13), 79 involved a foreign partner, of whom over half were from either the USA, the UK or the Netherlands. The leading Ugandan researchers were Professor Eugene Kinyanda of the MRC AIDS research unit in Entebbe and Professor Seggane Musisi of Makerere University in Kampala; together they contributed to 39 of these 92 papers. However, there were a total of 114 different Ugandan authors on these papers. Of Lebanon’s 148 citable papers, 100 were international, and these had a mean ACI of 33.6, compared with just 7.8 cites for the domestic papers. Lebanon’s citable output was dominated by the American University in Beirut, with contributions to 57 of the papers (39%). Again, there were a large number (190) of different Lebanese contributors to these papers.

Turkey’s citation performance is likely to be poor because 26% of its citable papers were in Turkish; they averaged only 1.7 cites per paper compared with 7.9 for the ones in English. So, the policy of the WoS in processing these non-English language journals has downgraded Turkey’s citation score. However, the Turkish-language journal, Türk Psikiyatri Dergisi (Turkish Journal of Psychiatry) also has English-language texts in the online version, and so is much better cited (ACI = 3.5). By contrast, Iran published almost exclusively in English and so its citation performance (mean ACI = 9.0) was superior. However, if research is to be used nationally to benefit patients, publications in the national language are likely to have more immediate influence than ones in English.

One potential cause of the papers from Turkey (and Iran) not being more influential is the lack of contestable funding in these countries. For example, in Turkey, of the 6667 domestic papers, only 563 (8.4%) acknowledged any financial support, and most of this (406 papers, 72%) was from university own funds. Only 77 papers (1.2%) acknowledged the support of TUBITAK, the Scientific and Technological Research Council of Turkey. In Iran, of the 3165 domestic papers, 1464 (46%) did acknowledge funding, but again, most of this (1314 papers, 90%) was from universities, and only 49 (1.5%) acknowledged the INSF, the Iran National Science Foundation. So it appears that in these two countries, there was very little contestable funding for mental health disorders research. Table 9 shows that the presence of either TUBITAK or INSF increased both JIF and ACI, but the effects were not dramatic. Papers without any funding acknowledgements performed less well than ones with one or more.

thumbnail
Table 9. Mean Journal Impact Factors (JIF) and Actual Citation Impact (ACI, five years) for Turkish and Iranian domestic mental health disorders papers with different sets of funding acknowledgements.

https://doi.org/10.1371/journal.pone.0250414.t009

4.5 Limitations of this study

The main limitation is that the filter for mental health disorders was not as good as we would have wished. For other medical subject areas we have usually been able to develop a filter with both precision and recall above 0.9. This was not possible for mental health disorders because many of them have "ordinary" words to describe them, such as "depression", which have several other meanings. We tried to avoid these by the removal of papers in a long list of non-medical subject areas but this was inevitably not complete.

A second limitation is that we have used only one bibliometric source, the WoS, in order to compile our own database. There will be additional relevant papers recorded in others, such as Scopus and MedLine. However, the different formats would have made analysis difficult, particularly for the comparison of mental health disorders research with all biomedical research, and the analysis of citations. The WoS is carefully curated, and in 2015 its journal coverage was extended to include many more journals published in "non-traditional" countries. Thus from 2008–14, it included papers in 100 journals published in OIC countries (primarily in Turkey, n = 37), but in 2015–17 it covered 235 such journals, with 98 from Turkey and 54 from Iran. However, the only languages spoken in OIC countries whose papers were covered were Turkish (n = 1598) and Malay (n = 11).

A third limitation is that we have not been able to measure the "quality" of the research papers other than through journal impact factors and counts of citations in the serial literature. The term "quality" is an elusive concept, and should include additional measures such as the citation of papers on clinical practice guidelines (CPGs), their citation on patents, and their citation on policy documents. However a particular difficulty with the research outputs from OIC countries is that few of them publish CPGs, and they do not take out many patents, so that these measures can really only be applied to documents from non-OIC countries, and very few OIC papers will be cited in this way.

4.6 Conclusions

Although the OIC countries as a group are publishing more research on mental health disorders, relative to their disease burden, than either Europe, or Canada and the USA, some individual countries are under-performing in view of their wealth and the rising disease burden that they face. More international collaboration would help, especially between different OIC countries which may share common social norms. In particular, suicide and self-harm are seriously under-researched, and lessons could be learned from countries where research-based methods of prevention have achieved some success.

Supporting information

S1 Appendix. The mental health disorders filter for use on the Web of Science.

https://doi.org/10.1371/journal.pone.0250414.s001

(DOCX)

Acknowledgments

We are grateful to Philip Roe of Evaluametrics Ltd for the provision of macros that enabled us to carry out the analysis.

References

  1. 1. Zeinoun P, Akl EA, Maalouf FT, & Meho LI. (2020) The Arab Region’s Contribution to Global Mental Health Research (2009–2018): A Bibliometric Analysis. Frontiers in Psychiatry, 11: 182. pmid:32265754
  2. 2. Large M, Nielssen O, Farooq S, & Glozier N. (2010) Increasing Rates of Psychiatric Publication from Low- and Middle-Income Countries. International Journal of Social Psychiatry, 56(5): 497–506. pmid:19651690
  3. 3. Duan L, Gao YF, Shao XJ, et al. (2020) Research on the Development of Theme Trends and Changes of Knowledge Structures of Drug Therapy Studies on Major Depressive Disorder Since the 21(st)Century: A Bibliometric Analysis. Frontiers in Psychiatry, 11: 647. pmid:32754061
  4. 4. Carvalho C, Peste F, Marques TA, Knight A, & Vicente LM. (2020) The Contribution of Rat Studies to Current Knowledge of Major Depressive Disorder: Results From Citation Analysis. Frontiers in Psychology, 11: 1486. pmid:32765345
  5. 5. Tran BX, McIntyre RS, Latkin CA, et al. (2019) The Current Research Landscape on the Artificial Intelligence Application in the Management of Depressive Disorders: A Bibliometric Analysis. International Journal of Environmental Research and Public Health, 16(12): 2150. pmid:31216619
  6. 6. da Costa BFC, Ramalho A, Goncalves-Pinho M, & Freitas A. (2020) Suicide Mortality Rate as a Sustainable Development Goal (SDG): A Bibliometric Analysis. Psychiatric Quarterly (in press). pmid:33211227
  7. 7. Minayo MCD, Figueiredo AEB, Mangas RMD. (2019) Study of scientific publications (2002–2017) on suicidal ideation, suicide attempts and self-neglect of elderly people hospitalized in Long-Term Care Establishments. Ciencia & Saude Coletiva, 24(4): 1393–1404. pmid:31066841
  8. 8. Zhang NY, Zheng XJ, Liu HX, Zheng QS, & Li LJ. (2020) Testing whether the progression of Alzheimer’s disease changes with the year of publication, additional design, and geographical area: a modeling analysis of literature aggregate data. Alzheimers Research & Therapy, 12(1): 64. pmid:32456710
  9. 9. Dong R., Wang H., Ye J.S., Wang M.S., & Bi Y.L. (2019) Publication Trends for Alzheimer’s Disease Worldwide and in China: A 30-Year Bibliometric Analysis. Frontiers in Human Neuroscience, 13. pmid:31447661
  10. 10. Serrano-Pozo A, Aldridge GM, Zhang Q. (2017) Four Decades of Research in Alzheimer’s Disease (1975–2014): A Bibliometric and Scientometric Analysis. Journal of Alzheimers Disease, 59(2): 763–783. pmid:28671119
  11. 11. Pallari E., Soukup T., Kyriacou A., & Lewison G. (2020) Assessing the European impact of alcohol misuse and illicit drug dependence research: clinical practice guidelines and evidence-based policy. Evidence-Based Mental Health,23: 67–76. ebmental-2019-300124 pmid:32229480
  12. 12. Vega-Almeida RL, Arencibia-Jorge R. (2019) The dark side of Internet: a bibliometric study of online addictive behaviors. Revista Espanola de Documentacion Cientifica, 42(4): e251.
  13. 13. Gordon AJ, Saba SK. (2016) Confronting the opioid epidemic through publication, promotion, and dissemination of evidence-based addiction scholarship. Substance Abuse, 37(3): 379–380. pmid:27712565
  14. 14. Bramness JG, Henriksen B, Person O, & Mann K. (2014) A Bibliometric Analysis of European versus USA Research in the Field of Addiction. Research on Alcohol, Narcotics, Prescription Drug Abuse, Tobacco and Steroids 2001–2011. European Addiction Research, 20(1): 16–22. pmid:23921359
  15. 15. Berg Brigham K., Darlington M., Wright J.S.F., Lewison G., Kanavos P., & Durand-Zaleski I. (2016) Mapping research activity on mental heatlh disorders in Europe: study protocol for the Mapping_NCD project. Health Research Policy and Systems 14: 39. pmid:27230585
  16. 16. Begum M., Lewison G., Wölbert E., Berg Brigham K., Darlington M., Durand-Zaleski I., et al. (2020) Mental health disorders research in Europe, 2001–18. Evidence-Based Mental Health, 23: 15–20. pmid:32046988
  17. 17. Andrade L., Caraveo-Anduaga J.J., Berglund P., et al. (2000) Cross-national comparisons of the prevalences and correlates of mental disorders. Bulletin of the World Health Organization, 78(4): 413–426 pmid:10885160
  18. 18. Andrade L., Caraveo-Anduaga J.J., Berglund P., et al. (2003) The epidemiology of major depressive episodes: results from the International Consortium of Psychiatric Epidemiology (ICPE) Surveys. International Journal of Methods in Psychiatric Research, 12(1): 3–21. pmid:12830306
  19. 19. Alhasnawi S., Sadik S., Rashid M., et al. (2009) The prevalence and correlates of DSM-IV disorders in the Iraq Mental Health Survey (IMHS)‏ 8 (2): 97–109
  20. 20. Altwaijri Y.A., Al-Habeeb A., Al-Subaie A.S., et al. (2020) Twelve-month prevalence and severity of mental disorders in the Saudi National Mental Health Survey. International Journal of Methods in Psychiatric Research 29(3): e1831 pmid:33245602
  21. 21. Lewison G (1996) The definition of biomedical research subfields with title keywords and application to the analysis of research outputs. Research Evaluation, 6(1): 25–36
  22. 22. Lewison G. & Paraje G. (2004) The classification of biomedical journals by research level. Scientometrics, 60(2): 145–157.
  23. 23. WHO (2005) World Health Organization: Assessment Instrument for Mental Health Systems. WHO, Geneva
  24. 24. Frame J.D. & Narin F. (1977) The international distribution of biomedical publications. Federation Proceedings, 36(6): 1790–1795 pmid:856633
  25. 25. Lewison G., Thornicroft G., Szmukler G., & Tansella M. (2007) Fair assessment of the merits of psychiatric research. British Journal of Psychiatry, 190: 314–318. pmid:17401037
  26. 26. Rezaee-Zavareh M.S., Karimi-Sari H., & Alavian S.M. (2016) Iran, sanctions, and research collaborations. The Lancet, 387(10013): 28–29.
  27. 27. Kokabisaghi F., Miller A.C., Bashar F.R., Salesi M., Zarchi A.A.K., Keramatfar A., et al. (2019) Impact of United States political sanctions on international collaborations and research in Iran. BMJ Global Health 4:e001692. pmid:31544001
  28. 28. Aggarwal A., Patel P., Lewison G., Ekzayez A., Coutts A., Fouad F., et al. (2020) Non-communicable disease research in the Middle East and North Africa (MENA) region, 1991–2018: Evidence to inform regional research, health systems capability and capacity planning. PLoS ONE, 15(4): e0232077.
  29. 29. Barnhofer T., Crane C., Brennan K., Duggan D.S., Crane R.S., Eames C., et al. (2015) Mindfulness-Based Cognitive Therapy (MBCT) Reduces the Association Between Depressive Symptoms and Suicidal Cognitions in Patients With a History of Suicidal Depression. Journal of Consulting and Clinical Psychology, 83(6): 1013–1020 pmid:26302249
  30. 30. Armitage C.J., Rahim W.A., Rowe R., & O’Connor R.C. (2016) An exploratory randomised trial of a simple, brief psychological intervention to reduce subsequent suicidal ideation and behaviour in patients admitted to hospital for self-harm. British Journal of Psychiatry, 208(5): 470–476 pmid:26743808
  31. 31. Geraci J., Murray C., Kapil-Pair K.N., Herrera S., Sokol Y., Cary J., et al. (2020) The modern-day Odysseus: How mental health providers can better reintegrate modern warriors and mitigate suicide risk. Journal of Clinical Psychology pmid:31951284
  32. 32. Oyewumi L.K. & Kazarian S.S. (1992) Abnormal eating attitudes among a group of Nigerian youths. 2. Anorexic behavior. East African Medical Journal, 69(12): 667–669 pmid:1298630
  33. 33. Vardar E. & Erzengin M. (2011) The Prevalence of Eating Disorders (EDs) and Comorbid Psychiatric Disorders in Adolescents: A Two-Stage Community-Based Study. Turk Psikiyatri Dergisi 22 (4): 205–212 pmid:22143945