Profile of scientific production on nursing technology construction, validity and application: a bibliometric study

ABSTRACT Objective: to analyze the profile of scientific production on nursing technology construction, validity and application. Methods: this is a bibliometric study, carried out in six databases, based on the Methodi Ordinatio application, arranged in nine stages. To represent the findings, the VOSviewer® software was used. Results: 346 studies were identified, obtained from BDENF, CINAHL, EMBASE, LILACS, PubMed/MEDLINE, Scopus and Web of Science. There was a predominance of the English language, and 20% of the authors hold more than 25% of studies. Only two journals account for 25% of studies in the period studied. Twenty-six studies were selected for the InOrdinatio classification. Nursing Process (23%) stood out among the studies. The most produced technology was software (27%), and 50% of works describe construction and validity. Conclusions: there is an emphasis on the creation of educational technologies, especially information technology. The data demonstrates opportunities for future research in the area.


INTRODUCTION
The process of building technological devices permeates different formats and molds.Methodological research is the type that focuses on product development and usually involves complex methods.It is a methodology that can also be applied to investigations of the formats for obtaining and organizing data, in addition to conducting rigorous research (1)(2) .
It is capable of handling research tool and method development, validity and assessment.In this type of study, the researcher aims to develop a reliable and usable product that can be used by other researchers and other people.This method is applicable in any scientific area, dealing with complex phenomena, such as individuals' behavior or health (1)(2) .
In nursing, there is a large number of methodological studies with a view to producing care, management and/or educational technologies.In addition to these, it is common to find proposals for international instrument assessment and cultural adaptation for use in the country of interest (3)(4) .In general, the focus of methodological studies is on developing constructs applicable in the science and profession of nursing (5) .
As a main characteristic, these studies are presented in the form of chained, iterative and interactive processes, in which the stages of development of a technology rest.Some division models are currently assumed, such as carrying out situational diagnosis, organizing literature reviews, building technology, validating and testing (3,6) .
Broadly, the term "technology" can refer to techniques, methods, instruments, procedures and equipment that promote execution and generate products and services.In the health area, especially with regard to nursing service provision, the adoption of technologies is capable of refining professional practices, interpersonal relationships and the management of processes within services (2,6) .In this way, the application of technologies occurs in different ways and has its meaning attributed according to its use (3) .
Given the scientific visibility that methodological studies have gained and nursing engagement in the production of these studies, the question is how they are used by researchers in the development of new research (7) .Thus, carrying out this study proposes an analysis of scientific activity, through quantitative study, on the use of different stages in methodological research in nursing, since there is no consensus in the literature on the methodological process in creating, validating and applying nursing technologies as well as exploring methods and aspects that contribute to reflections on production and scientific advancement in this field (7)(8) .

OBJECTIVE
To analyze the bibliometric profile of scientific production on nursing technology construction, validity and application.

Ethical aspects
The research was not submitted for consideration by a Research Ethics Committee, given that it was carried out with secondary data and in the public domain.However, study copyright was preserved.

Study design, period and place
This is a bibliometric study about nursing technology construction, validity and application.This method is characterized by highlighting metrics, indicators, production and scientific dissemination of a given topic (9) .
It was based on Methodi Ordinatio, a multi-criteria aid tool that allows articles to be ordered considering three factors: number of citations; Impact Factor (metric); and year of publication (8) .Furthermore, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) (10) flowchart guidelines were used, present in the study protocol registered on the Figshare platform (11) .
In this regard, this study followed the nine proposed steps: 1) research intention definition; 2) preliminary research in databases; 3) definition and combination of keywords and databases; 4) definitive search and data collection; 5) filtering procedure; 6) identification of Impact Factor, year of publication and number of citations; 7) classification of articles in InOrdinatio using the Rankln spreadsheet; 8) location of texts in full format; 9) systematic reading and analysis of articles (12) .
A preliminary search was carried out in the following databases: Nursing Database (BDENF); Cumulative Index to Nursing and Allied Health (CINAHL); EMBASE; Latin American and Caribbean Literature in Health Sciences (LILACS); MEDLINE via National Library of Medicine (PubMed); Scopus; and Web of Science (WoS).Data was collected from May to June 2023.

Population or sample; inclusion or exclusion criteria
In the first stage, the PICo (13) strategy was used to formulate the research question "What is the profile of scientific productions on nursing technology construction, validity and application?", with P (problem): nursing technologies, I (interest): construction, validity and assessment studies, and Co (context): nursing in its multiple intervention scenarios.
Scientific articles on nursing technology construction, validity and/or application, available in Portuguese, Spanish and English, were included.The time frame from 2011 was used, as in that year there was an increase in studies (theses and dissertations) on the topic in the area, in addition to the expansion of graduate programs, especially professional programs (8) .Articles in editorial formats, letters to the editor and opinion articles were excluded.

Study protocol
After the second stage of preliminary research in the databases, the search for studies began through remote access to the In the third stage, to define the keywords, Portuguese and English were used with the following combination: ("pesquisa metodológica em enfermagem" OR "nursing methodology research") AND ("enfermagem" OR "nursing") AND ("tecnologia educacional" OR "educational technology" OR "tecnologia" OR "technology" OR "tecnologias" OR "technologies").This search strategy was standardized in databases and electronic portals, as shown in Chart 1.
In the fourth stage, definitive search and data collection, the results were exported in the Research Information Systems (RIS) format to the Rayyan ® review manager software (14) .In the fifth stage, duplicate documents were detected and excluded, and the remaining articles were analyzed by reading titles and abstracts by three researchers, one specialist and two PhD holders, independently, responsible for selection in two stages, with masking, from the perspective of maintaining methodological rigor and double-blind review.
Conflicts between these were decided by a third researcher with a PhD, called upon to define selection.JabRef ® and Microsoft Excel ® were used to build the bibliographic portfolio.In the sixth stage, Impact Factor, year of publication and number of citations via Google Scholar ® were identified.In the seventh stage, the InOrdinatio value of each article was generated using the Rankln version 2.0 spreadsheet.This value was acquired using the InOrdinatio 2.0 formula = {(Δ* IF) -[λ* (ResearchYear -Pub-Year)/HalfLlife] + Ω* ∑ Ci/[(ResearchYear+1) -PubYear]} (15) .Thus, 10 (greatest importance) was established for the constants Δ (Impact Factor), λ (year of publication), Ω (number of citations).In this way, the articles were classified in descending order according to the result obtained.
The eighth stage was carried out simultaneously with the sixth stage, in which the selected articles were downloaded.The ninth stage was partially met, as only a skimming reading of the articles selected to compose the bibliographic portfolio of this review was carried out, as reading the studies in full is not the objective of bibliometric research.

Analysis of results, and statistics
To analyze the results, the three classic laws of bibliometrics were applied: I) Lotka's Law: to analyze author productivity; II) Bradford's Law: to assess journal productivity; III) Zipf's Law: to assess keyword frequency (8) .
The data was organized in Microsoft Excel ® spreadsheets.The data were analyzed descriptively and, to represent the findings of Lokta's and Zipf's Laws, the Visualizing Scientific Landscapes (VOSviewer ® ) version 1.6.19 was used, which consists of a representation referring to the occurrence of terms as well as their relationships, in which the thickness of the connections indicates the intensity of cooperation between the terms (16) .

RESULTS
The initial search, according to the inclusion criteria, resulted in a total of 346 studies, which came from the following databases: BDENF (25); CINAHL (7); EMBASE (1); LILACS (25); PubMed/MEDLINE (159); Scopus (124); and Web of Science (5).In Rayyan ® , 124 duplicate articles were identified and excluded, leaving 222 studies as well as information on the main publication journals, authors and language of origin; these were part of the scope to be analyzed according to Lotka's, Bradford's and Zipf's Laws.After reading the title and abstract of the 222 articles in Rayyan ® , 196 were excluded because they were not closely linked to the topic.Thus, the final selection of studies to compose the bibliographic portfolio was 26 articles to be analyzed by Methodi Ordinatio.

Database
Search strategy

BDENF/ LILACS
("pesquisa metodológica em enfermagem" OR "nursing methodology research") AND ("enfermagem" OR "nursing") AND ("tecnologia educacional" OR "educational technology" OR "tecnologia" OR "technology" OR "tecnologias" OR "technologies") AND (db:("LILACS" OR "BDENF"))   The total number of authors was 653, responsible for 701 authors, and the number of documents according to the number of authors was as follows: one author (Charalambous, A) published four articles; two authors published three articles; 41 authors published two articles; and 609 authors published only one article.Hence, 20% of authors accounted for 25.39% of studies, as explained in Table 1.
Figure 1 shows the analysis of co-authorship network.Using the filter of at least two occurrences of authors in articles, 14 clusters and a total of 642 items were generated, with 23 connections between the authors.The scientific influence of certain authors is observed, responsible for concentrating the focus of scientific productions and for greater numbers of connections with others.
Regarding keywords, 911 terms were found, with a general frequency of 3,537 repetitions, being categorized into three zones, such as trivial information (22), interesting information (192) and noise (697) according to the number of repetitions.Table 1 shows the details of the result of Zipf's Law.
The analysis of the distribution of keywords was carried out using VOSviewer ® and is represented in Figure 2. In this assessment, the filter of at least two word occurrences in articles was used, causing the appearance of 351 clusters, of which were 26 were selected to compose this review.In Figure 2, the arrangement of terms in Portuguese and English can be seen, of which the keyword nursing methodology research stood out, with 179 occurrences in the texts.The main study topic was the Nursing Process (NP) (6; 23%), followed by nursing fundamentals (12%) and infectious diseases (12%), with three studies each.The topics surgical nursing (8%), neonatology (8%), obstetrics (8%) and oncology (8%) had two studies each.The topics with one publication were hematology (4%), nephrology (4%), adult health (4%), patient safety (4%), nursing theories (4%) and emergency (4%).

DISCUSSION
Less than ten years ago, innovation and technological development were still an incipient scientific practice in nursing.However, it is known that the proposition and use of technologies enable improvements in quality of health care, with better costeffectiveness and efficiency, as knowledge networks are used to build products arising from their practice and that provide technological innovation to be closer to users' reality (5) .
On the other hand, methodological studies debuted in nursing in 2006 and showed a considerable increase in studies from 2015 (42) , making it imperative to develop technologies in their different stages, such as creation, validity and application of products and processes for different purposes (6) .It is noteworthy that the largest percentage of productions present in this study corresponds to research published in English and with exponential growth over the last two decades, with the majority of studies published in 2012.Technological development began to have a strong impact on production of scientific knowledge, in nursing and health, taking into account the multiple individual and collective demands that arise in health care and education (8) .
Furthermore, English is also a universal language for science, as it allows all researchers around the world to communicate and exchange information using a single language.As a consequence of this act, there has been an increase in studies in English over the years as a reflection of efforts of scientists, educational institutions and journals with a view to internationalizing scientific studies (43) .
As a result of studies assessed by the InOrdinatio method, the majority of studies are from Brazilian authors.However, they also have translation and dissemination of their texts into English, which reinforces the strategy of using English as a measure of internationalization of Brazilian scientific productions, in addition to increasing Impact Factor, greater possibility of reading and citation when greater access to studies is provided (44) .
Expanding access to studies is directly related to greater qualification and prestige of journals so that nursing production advances in quality and visibility.Prestigious journals seek established vehicles, such as important databases, libraries and scientific repositories, to disseminate their scientific productions with a view to ensuring recognition and dialogue between the scientific community in different fields of interest (45) .
Furthermore, the results of this review point to a concentration of authorship, given that one author published four articles and 609 authors published only one article each.This finding supports Lotka's Law, which describes the pattern of authors' scientific production, i.e., it states that few authors, authorities on a subject, produce a lot, and many authors, probably with less prestige and a broad spectrum of study, produce little on the same topic.This law allows checking the productivity of authors and the most developed research centers in a given area (46)(47) .
Studies that identify productivity and centers of excellence in a given area are important for consolidating and strengthening this field of investigation.This perspective is highlighted in a documentary study that draws attention to the adoption and conduct of lines of research in nursing that involve and present similar themes in scientific research with investigative traditions, produce projects with affinities between them and with a greater direction of production, contributing to systematization of scientific knowledge (48) .
Concerning Zipf's Law, it was shown that a smaller number of words were cited many times and that many words were cited few times, therefore, an inversely proportional result.As expected, the word "nursing methodology research" had the highest occurrence, followed by elements that are components, such as "nursing research education" and "learning", since the study aims to analyze the bibliometric profile of scientific production on nursing technology construction, validity and application.
Methodological studies enable investigation to obtain and organize data to construct, validate and assess, according to rigorous methodological precepts, such as research methods, to develop reliable instruments that have applicability in different realities and in different areas of knowledge, such as nursing, with a view to creating and validating different technological products, such as educational technologies (ET) (49) .
The type of methodological study was the most discussed in the research found, coming mainly from construction and validity studies.The first phase of methodological studies (production) is built based on scientific evidence present in the literature, proceeding with the review of studies available in the literature and evidence of reality, which requires primary studies both for situational diagnosis and to promote shared construction and facilitate constructing technology (50) .
In relation to the areas of knowledge, it was identified that technology application was more related to NP. Technology use promotes adherence to NP by nurses when compared to rates before the use of technologies (51) .Furthermore, nursing's interest in implementing systematized and quality care is evident as well as the rigor in complying with Resolution 358 of 2009 of the Federal Nursing Council (COFEN -Conselho Federal de Enfermagem) in making the use of NP mandatory in public or private health services (52) .
Technologies, when developed for educational use, are endowed with knowledge that aims to produce/prepare, apply/ intervene and monitor an educational process.Furthermore, they are instruments that enable assessing health education, as they enable health actions, supported by ET, that come closer to individuals' reality and promote a higher quality of life (51) .The act of creating an ET based on scientific evidence allows the target audience to have access to a cluster of content made available in an easy, practical and current way, with the provision of safe information in relation to the content covered (53) .It is assumed that technology production arises from the perception of the need understood in discussion, sharing of knowledge and creativity encouragement (54) .This reflects in the increase in production related to ET construction and validity, as they constitute benefits for the population with a significant improvement in quality of life, promoting the adoption of healthy behaviors, transformation of practices, innovation in the way of learning to learn and strengthening meaningful learning with autonomy and empowerment (55)(56) .
The validity stage is related to different aspects, such as validating content, appearance, semantics, usability, applicability, playfulness, interactivity, among other actions.It is considered that there is the possibility of different interactions at the time of validity, which requires planning to develop the steps, which can be concomitant or sequential (6) .Making a technology with an educational focus valid means formalizing the relevance of content developed from the perspective of encompassing information that is suitable and safe for use in an educational manner, following the required methodological precepts (57) .
Therefore, it is important that, after creating an ET, the next step is validity; this step is carried out by specialists with expertise in the area of study presented.The Ministry of Health (MoH) aims that technology production can contain clear, accessible, intelligible language and appropriate to the target audience's reality, as it can help or hinder the transmission of the desired message; therefore, the experience of experts is essential for ET to be considered valid (58) .
With regard to the technological artifact produced, there was a prevalence of software, which is a logical set of information that uses algorithms for data processing and which results in a type of program (59) .In the educational context, these artifacts promote new learning experiences and, when used to compose educational material, they demonstrate an innovative practice in the teaching and learning process (60) .

Study limitations
Assembling search string represented a critical step, since the inappropriate choice of descriptors could result in exclusion of relevant information.Furthermore, the number of studies associated with the search strings may be a limitation, as a small number may indicate a very restrictive search.These limitations made the development and approach careful and judicious in conducting the research, aiming to mitigate these obstacles and ensure the integrity and relevance of results.

Contributions to nursing, health or public policy
The present study explores what has been produced by nursing regarding the development of technologies, especially those based on consolidated scientific methods and well described in the literature.Therefore, this research carries data that can support new methodological studies, in addition to bringing insights that enable creating collaborative networks for technology production.

CONCLUSIONS
Technology development plays a fundamental role in consolidating nursing as a science.It is through the process of construction and validity of what is created for the profession that the class autonomy becomes evident.This study evokes a variety of strategies adopted by the authors of the works analyzed in the search for developing their technologies.This strengthens the characteristic of plurality present in the theme of technological productions: the infinity of possibilities to be developed.
There is still a strong appeal for ET production.The tendency to develop products aimed at teaching nursing, especially related to information technologies (software, applications and IT support), is a worldwide characteristic and is present in the different contexts in which the profession operates, such as clinical practice, patient management, care and improvement of general institutional processes.
With the data from this profile, the potential for future studies also stands out, since the appreciation of the topic of bibliometric production leads to insights capable of elucidating how technological production in nursing occurs.It is recommended that further research be carried out, considering further specifying the branches through which nursing technology production can permeate, exploring its types-classifications and other aspects.

AVAILABILITY OF DATA AND MATERIAL
The protocol for this study was registered on the Figshare platform (https://figshare.com/s/4cc25bdcc1711a586f64).

CONTRIBUTIONS
Lima FC, Sagica TP and Souza JLM contributed to study/research conception or design and data analysis and/or interpretation.Prado ML and Santana ME contributed to data analysis and/or interpretation and final review with critical and intellectual participation in the manuscript.Peixoto IVP and Valois RC contributed to the final review with critical and intellectual participation in the manuscript.

Figure 2 -Figure 1 -
Figure 2 -Distribution network of keywords in scientific production on nursing technology construction, validity and application.2011-2023 Chart 2 characterizes the profile of the 26 selected studies classified according to InOrdinatio, based on the journal's Impact Factor (IF), number of citations (CI) and year of publication.Only three studies (1, 2 and 3) have InOrdinatio greater than 80, i.e., a better bibliographic portfolio of the state of the art, and, of the 26 studies, only two have InOrdinatio less than one.

the Universidade 10 of Profile of scientific production on nursing technology construction, validity and application: a bibliometric study Lima
FC, Sagica TP, Souza JLM, Prado ML, Santana ME, Peixoto IVP, et al.

Table 1 -
Scientific production on nursing technology construction, validity and application according to Bradford's, Lokta's and Zipf's Laws.2011-2023

10 of Profile of scientific production on nursing technology construction, validity and application: a bibliometric study
Lima FC, Sagica TP, Souza JLM, Prado ML, Santana ME, Peixoto IVP, et al.Characterization of scientific production on nursing technology construction, validity and application according to InOrdinatio.2011-2023

Profile of scientific production on nursing technology construction, validity and application: a bibliometric study
Lima FC, Sagica TP, Souza JLM, Prado ML, Santana ME, Peixoto IVP, et al.

of scientific production on nursing technology construction, validity and application: a bibliometric study
Lima FC, Sagica TP, Souza JLM, Prado ML, Santana ME, Peixoto IVP, et al.