Acessibilidade / Reportar erro

Assessment of the measurement properties of the post stroke motor function instruments available in Brazil: a systematic review

Abstract

Background

While there are several instruments in Brazil that measure motor function in patients after stroke, it is unknown whether the measurement properties of these instruments are appropriate.

Objective

To identify the motor function instruments available in Brazil for patients after stroke. To assess the methodological quality of the studies and the results related to the measurement properties of these instruments.

Method

Two independent reviewers conducted searches on PubMed, LILACS, CINAHL, Web of Science, and Scopus. Studies that aimed to cross-culturally adapt an existing instrument or create a Brazilian instrument and test at least one measurement property related to motor function in patients after stroke were included. The methodological quality of these studies was checked by the COSMIN checklist with 4-point rating scale and the results of the measurement properties were analyzed by the criteria developed by Terwee et al.

Results

A total of 11 instruments were considered eligible, none of which were created in Brazil. The process of cross-cultural adaptation was inadequate in 10 out of 11 instruments due to the lack of back-translation or due to inappropriate target population. All of the instruments presented flaws in the measurement properties, especially reliability, internal consistency, and construct validity.

Conclusion

The flaws observed in both cross-cultural adaptation process and testing measurement properties make the results inconclusive on the validity of the available instruments. Adequate procedures of cross-cultural adaptation and measurement properties of these instruments are strongly needed.

stroke; validity of tests; reproducibility of results; translating; physical therapy


BULLET POINTS

  • 11 studies were found that assessed post-stroke motor function in Brazilian patients.

  • Most of the cross-cultural adaptation was conducted without the target population.

  • Flaws in the measurement properties made the results inconclusive.

  • Caution should be taken in the selection of instruments for research and clinical practice.

Introduction

Various measurement instruments have been created with the objective of assessing motor function in post-stroke individuals11. Soriano FFS, Baraldi K. Escalas de avaliação funcional aplicáveis a pacientes pós- Acidente Vascular Encefálico. Con Scientia e Saúde. 2010;9(3):521-30.

2. Pomeroy VM, King LM, Pollock A, Alison B, Peter L. Electrostimulation for promoting recovery of movement or functional ability after stroke. Cochrane Database Syst. Rev. 2006(2):1-74. http://dx.doi.org/10.1002/14651858.CD003241.pub2.
http://dx.doi.org/10.1002/14651858.CD003...
-33. Pollock A, Gill B, Pomeroy VM, Langhorne P. Physiotherapy treatment approaches for the recovery of postural control and lower limb function following stroke. Cochrane Database Syst. Rev. 2007(1):1-92. http://dx.doi.org/10.1002/14651858.CD001920.pub2.
http://dx.doi.org/10.1002/14651858.CD001...
. These instruments aim to verify the ability to maintain or change the body's position in space, walk and move around, move and handle objects, as well as verify motor coordination and fine manual motricity11. Soriano FFS, Baraldi K. Escalas de avaliação funcional aplicáveis a pacientes pós- Acidente Vascular Encefálico. Con Scientia e Saúde. 2010;9(3):521-30.

2. Pomeroy VM, King LM, Pollock A, Alison B, Peter L. Electrostimulation for promoting recovery of movement or functional ability after stroke. Cochrane Database Syst. Rev. 2006(2):1-74. http://dx.doi.org/10.1002/14651858.CD003241.pub2.
http://dx.doi.org/10.1002/14651858.CD003...
-33. Pollock A, Gill B, Pomeroy VM, Langhorne P. Physiotherapy treatment approaches for the recovery of postural control and lower limb function following stroke. Cochrane Database Syst. Rev. 2007(1):1-92. http://dx.doi.org/10.1002/14651858.CD001920.pub2.
http://dx.doi.org/10.1002/14651858.CD001...
. These abilities involve aspects related to activities and participation and the structure and function of the organs and systems, as described in the International Classification of Functioning, Disability, and Health (ICF)44. Leitão A. Manual da Classificação Internacional da Funcionalidade Incapacidade e Saúde (CIF). Lisboa: OMS; 2004..

The application of these instruments aims to measure upper limb function, trunk function, or global motor function11. Soriano FFS, Baraldi K. Escalas de avaliação funcional aplicáveis a pacientes pós- Acidente Vascular Encefálico. Con Scientia e Saúde. 2010;9(3):521-30.

2. Pomeroy VM, King LM, Pollock A, Alison B, Peter L. Electrostimulation for promoting recovery of movement or functional ability after stroke. Cochrane Database Syst. Rev. 2006(2):1-74. http://dx.doi.org/10.1002/14651858.CD003241.pub2.
http://dx.doi.org/10.1002/14651858.CD003...
-33. Pollock A, Gill B, Pomeroy VM, Langhorne P. Physiotherapy treatment approaches for the recovery of postural control and lower limb function following stroke. Cochrane Database Syst. Rev. 2007(1):1-92. http://dx.doi.org/10.1002/14651858.CD001920.pub2.
http://dx.doi.org/10.1002/14651858.CD001...
. Some instruments assess performance through the observation of performed activities, while others are based on questionnaires on motor function11. Soriano FFS, Baraldi K. Escalas de avaliação funcional aplicáveis a pacientes pós- Acidente Vascular Encefálico. Con Scientia e Saúde. 2010;9(3):521-30.

2. Pomeroy VM, King LM, Pollock A, Alison B, Peter L. Electrostimulation for promoting recovery of movement or functional ability after stroke. Cochrane Database Syst. Rev. 2006(2):1-74. http://dx.doi.org/10.1002/14651858.CD003241.pub2.
http://dx.doi.org/10.1002/14651858.CD003...
-33. Pollock A, Gill B, Pomeroy VM, Langhorne P. Physiotherapy treatment approaches for the recovery of postural control and lower limb function following stroke. Cochrane Database Syst. Rev. 2007(1):1-92. http://dx.doi.org/10.1002/14651858.CD001920.pub2.
http://dx.doi.org/10.1002/14651858.CD001...
. After stroke, motor function can present various degrees of impairment and generate social and economic loss. Therefore, it is essential to use valid instruments to achieve an effective rehabilitation55. Falcão IV, Carvalho EMF, Barreto KML, Lessa FJD, Leite VMM. Acidente Vascular Cerebral precoce: implicações para adultos em idade produtiva atendidos pelo Sistema Único de Saúde. Rev Bras Saude Mater Infant. 2004;4(1):95-102. http://dx.doi.org/10.1590/S1519-38292004000100009.
http://dx.doi.org/10.1590/S1519-38292004...

6. Ferreira LTD, Pinto EB. Perfil Funcional dos pacientes acometidos por acidente vascular encefálico de um centro de referência em Salvador. Fisioter Bras. 2008;9(2):81-5.
-77. Hendricks HT, van Limbeek J, Geurts AC, Zwarts MJ. Motor Recovery after Stroke: A systematic Review of the Literature. Arch Phys Med Rehabil. 2002;83(11):1629-37. http://dx.doi.org/10.1053/apmr.2002.35473. PMid:12422337.
http://dx.doi.org/10.1053/apmr.2002.3547...
.

In general, the instruments used in Brazil to assess post-stroke motor function were developed in other countries, usually in English and, consequently, targeted to the original population11. Soriano FFS, Baraldi K. Escalas de avaliação funcional aplicáveis a pacientes pós- Acidente Vascular Encefálico. Con Scientia e Saúde. 2010;9(3):521-30.,88. Ceccato RB, Almeida CI. O planejamento da reabilitação na fase aguda após acidente vascular encefálico. Acta Fisiátrica. 2010;17(1):33-47.. However, before an instrument can be used in a new country, culture, and/or language, a cross-cultural adaptation process is necessary. This process requires a standardized method involving the language translation and the cross-cultural adaptation to maintain its content validity99. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. http://dx.doi.org/10.1097/00007632-200012150-00014. PMid:11124735.
http://dx.doi.org/10.1097/00007632-20001...
,1010. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94-104. http://dx.doi.org/10.1111/j.1524-4733.2005.04054.x. PMid:15804318.
http://dx.doi.org/10.1111/j.1524-4733.20...
. After this process, the new scale should be applied to the new target population and its measurement properties can be analyzed to check if the adapted instrument truly measures the construct in the new setting99. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. http://dx.doi.org/10.1097/00007632-200012150-00014. PMid:11124735.
http://dx.doi.org/10.1097/00007632-20001...

10. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94-104. http://dx.doi.org/10.1111/j.1524-4733.2005.04054.x. PMid:15804318.
http://dx.doi.org/10.1111/j.1524-4733.20...

11. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
-1212. Kirshner B, Guyatt G. A Methodological framework for assessing health indices. J Chronic Dis. 1985;38(1):27-36. http://dx.doi.org/10.1016/0021-9681(85)90005-0. PMid:3972947.
http://dx.doi.org/10.1016/0021-9681(85)9...
.

The instrument can only be considered valid and reliable for use in a new cultural-clinical context through the adequate evaluation of the measurement properties99. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. http://dx.doi.org/10.1097/00007632-200012150-00014. PMid:11124735.
http://dx.doi.org/10.1097/00007632-20001...

10. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94-104. http://dx.doi.org/10.1111/j.1524-4733.2005.04054.x. PMid:15804318.
http://dx.doi.org/10.1111/j.1524-4733.20...
-1111. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
. The objectives of this systematic review were to identify the measurement instruments of motor functions in post-stroke individuals available in Brazil, to assess the methodological quality of the studies, and to assess the results of these studies.

Method

Two independent reviewers (EL and LS) conducted searches and selected eligible studies in the PUBMED, LILACS, SCOPUS, CINAHL, and WEB OF SCIENCE databases between February and March of 2014, according to the search strategy presented in Table 1. There was no language restriction.

Table 1.
Research strategies for each research database.

Either cross-cultural adaptation studies or Brazilian instruments that assessed the motor function of post stroke individuals in at least one item were considered eligible. Furthermore, these studies had to have verified at least one measurement property of these instruments. Studies that involved individuals with other neurological conditions were excluded.

The two reviewers (EL and LS) screened the studies by title and abstract performing a pre-selection through eligibility criteria on the computer screen. Then, they read the full text of the studies potentially eligible to confirm their inclusion. It was pre-defined that disagreements between two reviewers were arbitrated by a third reviewer (AL).

The data extraction was performed in a standardized way through a pre-established data extraction form. The following data were extracted: title, authors, year of publication, journal, study objectives, eligibility criteria of the participants, instrument objective (discriminative, predictive or evaluative)1212. Kirshner B, Guyatt G. A Methodological framework for assessing health indices. J Chronic Dis. 1985;38(1):27-36. http://dx.doi.org/10.1016/0021-9681(85)90005-0. PMid:3972947.
http://dx.doi.org/10.1016/0021-9681(85)9...
, number of subscales/items/domains, and domain assessed according to ICF44. Leitão A. Manual da Classificação Internacional da Funcionalidade Incapacidade e Saúde (CIF). Lisboa: OMS; 2004..

The evaluation of the methodological quality of the included studies was performed through the COSMIN checklist with 4-point rating scale, which is a tool created through the Consensus-based Standards for the selection of health Measurements Instruments (COSMIN), with the aim of scoring and classifying the quality of the methods used for the study of each measurement property1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

The COSMIN checklist with 4-point rating scale is composed of nine boxes: A- Internal consistency, B- Reliability, C- Measurement error, D- Content validity, E- Structural validity, F- Hypothesis tests, G- Cross-cultural validity, H- Criterion validity, and I- Responsiveness1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

Each box includes a series of items that assess the measurement property methodology. These items are classified on a scale of 4 points: 1- Poor, 2- Fair, 3- Good, and 4- Excellent. The final classification for each box is determined by the lowest score achieved by any of the items1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

In addition to the boxes mentioned above, there is still another box that should be completed for each measurement property. This box aims to identify the clinical-epidemiological profile of the population, analyzing age mean, distribution by gender, illness characteristic, country of origin, and spoken language1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

For example, to assess the internal consistency, box A presents 11 items: the first 3 items assess the missing data. Item 4 assesses the sample size; items 5, 6, and 7 assess questions related to unidimensionality; item 8 verifies the presence of other methodological flaws; and the other items verify the statistical method1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

Item 4 of this box assesses the sample size for internal consistency as follows: Excellent (N=100), Good (between 50 and 99 participants), Fair (between 30 and 40 participants), and Poor (less than 30 participants). Similar to item 4, the remaining items are scored on a 4-point scale, according to specific criteria. In the end, even if the instrument has obtained "excellent" classification in the other items, but in item 4 received a "good" score for having a sample size between 50 and 99 participants, the internal consistency of the instrument will be classified as having "good" internal consistency as the lowest score is used1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

Furthermore, the COSMIN recommends that to complement the evaluation of an instrument, the quality criteria developed by Terwee et al.1111. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
should be used; these criteria classify the measurement properties as Positive (+), Negative (-), or doubtful (?) focusing on the analysis of the obtained results1111. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
. The use of the Terwee et al.1111. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
criteria complements the evaluation of the measurement properties, as the COSMIN does not determine the cut offs that are considered adequate for the statistical analysis of each measurement property. In other words, the fact that a study used Cronbach's α, one of the statistical measurements advocated by COSMIN, to verify the internal consistency does not guarantee the quality of this property, as adequate values may not have been reached1111. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
,1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

For example, internal consistency receives a positive score when the unidimensionality is verified, with the participation of 100 or more individuals and through Cronbach's α (between 0.70 and 0.95). If α does not reach this interval, the score will be negative. When the unidimensionality is not verified, or if there is another methodological flaw, the score will be classified as inconclusive1111. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
.

Results

A total of 529 studies were found, of which only 14 studies1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...

18. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...

19. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112.

20. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...

21. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...

22. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...

23. Michaelsen SM, Rocha AS, Knabben RJ, Rodrigues LP, Fernandes CGC. Translation, adaptation and inter-rater reliability of the administration manual for the Fugl-Meyer assessment. Rev Bras Fisioter. 2011;15(1):80-8. http://dx.doi.org/10.1590/S1413-35552011000100013. PMid:21519719.
http://dx.doi.org/10.1590/S1413-35552011...

24. Maki T, Quagliato EMAB, Cacho EWA, Paz LPS, Nascimento NH, Inoue MMEA, et al. Estudo de Confiabilidade da aplicação da escala de Fugl-Meyer no Brasil. Rev Bras Fisioter. 2006;10(2):177-83. http://dx.doi.org/10.1590/S1413-35552006000200007.
http://dx.doi.org/10.1590/S1413-35552006...

25. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...

26. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...

27. Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056.
http://dx.doi.org/10.1590/S1413-35552009...

28. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.

29. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.
-3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
were included through the eligibility criteria (Figure 1). Two instruments (Test Évaluant les Membres supérieurs des Personnes Âgées - TEMPA2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
and the Jebsen-Taylor Test2121. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...
) were not specifically created for post-stroke individuals; however, they have been validated in Brazil for this population and were included in this review.

Figure 1.
Identification, selection, and inclusion of the studies.

In the 14 studies included, 11 instruments were identified. Three of them (Motor Activity Log - MAL1818. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112., Fugl-Meyer scale2323. Michaelsen SM, Rocha AS, Knabben RJ, Rodrigues LP, Fernandes CGC. Translation, adaptation and inter-rater reliability of the administration manual for the Fugl-Meyer assessment. Rev Bras Fisioter. 2011;15(1):80-8. http://dx.doi.org/10.1590/S1413-35552011000100013. PMid:21519719.
http://dx.doi.org/10.1590/S1413-35552011...
,2424. Maki T, Quagliato EMAB, Cacho EWA, Paz LPS, Nascimento NH, Inoue MMEA, et al. Estudo de Confiabilidade da aplicação da escala de Fugl-Meyer no Brasil. Rev Bras Fisioter. 2006;10(2):177-83. http://dx.doi.org/10.1590/S1413-35552006000200007.
http://dx.doi.org/10.1590/S1413-35552006...
, and National Institute of Health Stroke Scale - NIHSS2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
,2626. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...
) were analyzed in two studies each, and the other 8 in only one study. The characterization of the included studies is presented in Table 2.

Table 2.
Description of the instruments that assess the motor function of post-stroke individuals available in Brazil.

None of the included instruments were Brazilian, therefore all had to be submitted to the cross-cultural adaptation process. The most frequently measured properties were reliability (n=11 studies), construct validity through hypothesis testing (n=6 studies), and internal consistency (n=6 studies). None of the included studies assessed responsiveness. The evaluation of the measurement properties is shown in Table 3.

Table 3.
Evaluation of the methodological quality of the included studies through the COSMIN checklist with 4-point rating scale: Consensus-based standard for the selection of health measurement instruments.

Cross-cultural adaptation

Only one instrument (MAL)1818. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112. was adapted to Brazilian culture in accordance with the recommended method99. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. http://dx.doi.org/10.1097/00007632-200012150-00014. PMid:11124735.
http://dx.doi.org/10.1097/00007632-20001...
,1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
. The cross-cultural adaptation of the Rivermead Mobility Index (RMI)2222. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...
obtained a "good" classification, given that it is not clear whether an expert committee participated or whether a pre-test was conducted99. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. http://dx.doi.org/10.1097/00007632-200012150-00014. PMid:11124735.
http://dx.doi.org/10.1097/00007632-20001...
.

Six instruments1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...
,2121. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...
,2323. Michaelsen SM, Rocha AS, Knabben RJ, Rodrigues LP, Fernandes CGC. Translation, adaptation and inter-rater reliability of the administration manual for the Fugl-Meyer assessment. Rev Bras Fisioter. 2011;15(1):80-8. http://dx.doi.org/10.1590/S1413-35552011000100013. PMid:21519719.
http://dx.doi.org/10.1590/S1413-35552011...
,2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...

26. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...
-2727. Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056.
http://dx.doi.org/10.1590/S1413-35552009...
,3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
obtained a classification considered "poor" for the cross-cultural adaptation process. The TEMPA2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
and Motor Assessment Scale (MAS)2727. Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056.
http://dx.doi.org/10.1590/S1413-35552009...
were created through simple translations into Portuguese. The NIHSS2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
,2626. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...
was inadequately adapted in two studies, one of which only performed a single translation into Portuguese2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
. In the adaptation of the Wolf Motor Test (Wolf)1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...
, Jebsen-Taylor Test2121. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...
, and the Trunk Impairment Scale3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
, pre-tests were not performed either.

For the Fugl-Meyer Scale2323. Michaelsen SM, Rocha AS, Knabben RJ, Rodrigues LP, Fernandes CGC. Translation, adaptation and inter-rater reliability of the administration manual for the Fugl-Meyer assessment. Rev Bras Fisioter. 2011;15(1):80-8. http://dx.doi.org/10.1590/S1413-35552011000100013. PMid:21519719.
http://dx.doi.org/10.1590/S1413-35552011...
,2424. Maki T, Quagliato EMAB, Cacho EWA, Paz LPS, Nascimento NH, Inoue MMEA, et al. Estudo de Confiabilidade da aplicação da escala de Fugl-Meyer no Brasil. Rev Bras Fisioter. 2006;10(2):177-83. http://dx.doi.org/10.1590/S1413-35552006000200007.
http://dx.doi.org/10.1590/S1413-35552006...
, Posture Assessment Scale2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100., and Trunk Deficiency Scale2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99., the quality of the adaptation process was "fair" because it included a pre-test but did not include an adequate description of the assessed sample. However, the Fugl-Meyer Scale2323. Michaelsen SM, Rocha AS, Knabben RJ, Rodrigues LP, Fernandes CGC. Translation, adaptation and inter-rater reliability of the administration manual for the Fugl-Meyer assessment. Rev Bras Fisioter. 2011;15(1):80-8. http://dx.doi.org/10.1590/S1413-35552011000100013. PMid:21519719.
http://dx.doi.org/10.1590/S1413-35552011...
manual, which was produced in a different study to the production of the instrument, presented a "poor" process as it included only one translation into Portuguese. In the Posture Assessment Scale2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100. and Trunk impairment Scale2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99., the translation and back translation were performed by only one translator.

Reliability

All of the instruments were tested for reliability. Eight (MAS2727. Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056.
http://dx.doi.org/10.1590/S1413-35552009...
, MAL1818. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112., Wolf Motor Function Test1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...
, TEMPA2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
, Posture Assessment Scale2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100., Trunk impairment Scale3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
, and the study of the Fugl-Meyer manual2424. Maki T, Quagliato EMAB, Cacho EWA, Paz LPS, Nascimento NH, Inoue MMEA, et al. Estudo de Confiabilidade da aplicação da escala de Fugl-Meyer no Brasil. Rev Bras Fisioter. 2006;10(2):177-83. http://dx.doi.org/10.1590/S1413-35552006000200007.
http://dx.doi.org/10.1590/S1413-35552006...
) received a "poor" classification because they included fewer than 30 participants and used the intraclass correlation coefficient (ICC) when this was not indicated. The studies of the Fugl-Meyer Scale2323. Michaelsen SM, Rocha AS, Knabben RJ, Rodrigues LP, Fernandes CGC. Translation, adaptation and inter-rater reliability of the administration manual for the Fugl-Meyer assessment. Rev Bras Fisioter. 2011;15(1):80-8. http://dx.doi.org/10.1590/S1413-35552011000100013. PMid:21519719.
http://dx.doi.org/10.1590/S1413-35552011...
(N=50) and RMI2222. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...
(N=95) had good samples but were classified as "poor" for having used inadequate statistical methods (i.e. ICC and the Wilcoxon test, respectively). The Jebsen-Taylor Test2121. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...
was considered "fair" for presenting a sample between 30 and 49 individuals (n=40). The reliability of the NIHSS was verified in two studies with "good" methodology and samples of 51 and 62 participants, respectively2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
,2626. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...
.

Measurement error

The measurement error was verified in three instruments (Trunk impairment Scale2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99., Wolf Motor Function Test1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...
, and MAL1818. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112.) through the Bland Altman plot analysis; however, the methodological quality was classified as "poor" because the sample included less than 30 individuals.

Internal consistency

Six instruments1818. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112.,2121. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...
,2222. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...
,2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.

29. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.
-3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
were tested for internal consistency; however, the methodological quality was classified as "poor" in all of them. In five instruments (Posture Assessment Scale2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100., RMI2222. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...
, Jebsen Taylor Test2121. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...
, and Trunk impairment Scales2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.,3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
), the reason was the lack of factor analysis. Moreover, in the Posture Assessment Scale2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100. and Trunk impairment Scales2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.,3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
, the sample included less than 30 individuals and in the study of MAL1818. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112., the sample included less than 5 individuals per item of the instrument for unidimensionality.

Construct validity

Construct validity was analyzed in six instruments (MAL1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112., TEMPA2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
, Posture Assessment Scale2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100., NIHSS2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
, and Trunk Impairment Scales2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.,3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
) through the hypothesis tests by correlation with the Fugl Meyer Scale1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112.,2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
,2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.,2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99., Barthel Index2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
, Berg Balance Scale, and Functional Independence Measure3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
. The study method used in four of these instruments was classified as "poor" due to inadequate sample size (n<30)2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
,2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.

29. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.
-3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
.

The MAL1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112. and NIHSS2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
,2626. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...
presented "fair" methodological quality in the validity tests, as the hypotheses about the direction and magnitude of the correlation were not previously formulated or described in the study; however, it was possible to assume the expected direction for the correlation (positive or negative).

Terwee criteria

As for the evaluation of the results of the measurement property analysis using the criteria of Terwee et al.1111. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
, the majority of the studies presented doubtful results in the study of measurement properties, with the exception of the inter-examiner reliability of the NIHSS2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
,2626. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...
, which presented positive results with Kappa coefficient >0.70 in items 5a, 5b, 6a, and 6b (referring to upper and lower limb motor function) (Table 4).

Table 4.
Measurement properties assessment through the Terwee et al.

The results of the measurement error tests of the internal consistency and of construct validity were considered doubtful due to the methodological flaws presented, as described previously1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112.,2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100..

The ceiling and floor effects, which reflect interpretability, were verified in two instruments (Trunk Impairment Scale2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99. and Posture Assessment Scale2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.). The percentage of individuals who reached the minimum and maximum scores was lower than 15%, but with an inadequate sample size (<50). However, other measures of interpretability like the minimum clinically important difference and minimum important difference were not analyzed. Finally, criterion validity and responsiveness were not tested in any of the eligible studies.

Discussion

The results of this review showed that the available instruments in Brazil for assessing post-stroke motor function are arising from cross-cultural adaptation, not from newly developed Brazilian. However, the findings are inconclusive regarding the quality of the cross-cultural adaptation as well as from measurement properties, due to flaws with regards to methodology. The main methodological flaw observed during the cross-cultural adaptation process of the included instruments was the absence of a pre-testing of the final version1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...
,2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...

21. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...
-2222. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...
,2727. Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056.
http://dx.doi.org/10.1590/S1413-35552009...
,3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
. Only one instrument (Motor Activity Log - MAL)1818. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112. followed the recommended processes for an adequate cross-cultural adaptation.

The goal of applying the instrument in the target population (pre-test) before the measurement property analysis aims to identify possible imperfections in the interpretation of the items of an interview and the viability of the tasks proposed by the instrument for the target population. Therefore, the performance of the pre-test allows the identification of possible adjustments necessary in the instrument, based on the direct participation of the population for which it was adapted1111. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012. PMid:17161752.
http://dx.doi.org/10.1016/j.jclinepi.200...
.

Although some instruments performed a pre-test, most of the studies did not described the sample properly2424. Maki T, Quagliato EMAB, Cacho EWA, Paz LPS, Nascimento NH, Inoue MMEA, et al. Estudo de Confiabilidade da aplicação da escala de Fugl-Meyer no Brasil. Rev Bras Fisioter. 2006;10(2):177-83. http://dx.doi.org/10.1590/S1413-35552006000200007.
http://dx.doi.org/10.1590/S1413-35552006...
,2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.,2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.. To allow the generalization of the results of a cross-cultural adaptation, the COSMIN checklist recommends that the participants involved in the pre-test should be clinically and epidemiologically reported in terms of age, gender, characteristics of the illness, and source of patients (hospital, clinic, community, etc.)1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

The absence of a back translation was also verified in some instruments2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
,2727. Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056.
http://dx.doi.org/10.1590/S1413-35552009...
. This stage has the important aspect of allowing the verification of semantic equivalence between the original instrument and what was created in the new language, allowing necessary adjustments in the new version. It was also observed that, in some instruments2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.,2929. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99., the stages of translation and back translation were performed by a single translator. The performance of multiple translations is recommended in the literature because it allows the interaction between specialists in the construct and in the languages involved, allowing a more adequate process of cultural adaptation and the maintenance of semantic equivalence1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

Concerning the measurement properties, methodological flaws were also verified. The reliability was verified in all studies; however, in the majority of these, a sample size of less than 30 participants was selected1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...

18. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...

19. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112.
-2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
,2222. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...
,2727. Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056.
http://dx.doi.org/10.1590/S1413-35552009...

28. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.

29. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.
-3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
. The adequate number is at least 50 participants, and for an ideal sample, the recruitment of at least 100 participants is recommended1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

In addition, the intra-lass correlation coefficient was often chosen as the statistical method when it was, in fact, inadequate. The adequate method for instruments with ordinal type scores is the Kappa coefficient1717. Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013. PMid:21829991.
http://dx.doi.org/10.1590/S1413-35552011...

18. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...

19. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112.
-2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
,2222. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...

23. Michaelsen SM, Rocha AS, Knabben RJ, Rodrigues LP, Fernandes CGC. Translation, adaptation and inter-rater reliability of the administration manual for the Fugl-Meyer assessment. Rev Bras Fisioter. 2011;15(1):80-8. http://dx.doi.org/10.1590/S1413-35552011000100013. PMid:21519719.
http://dx.doi.org/10.1590/S1413-35552011...
-2424. Maki T, Quagliato EMAB, Cacho EWA, Paz LPS, Nascimento NH, Inoue MMEA, et al. Estudo de Confiabilidade da aplicação da escala de Fugl-Meyer no Brasil. Rev Bras Fisioter. 2006;10(2):177-83. http://dx.doi.org/10.1590/S1413-35552006000200007.
http://dx.doi.org/10.1590/S1413-35552006...
,2727. Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056.
http://dx.doi.org/10.1590/S1413-35552009...

28. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.

29. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.
-3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
. The only instrument with an adequate study method for reliability, the NHSS, presented flaws in the cross-cultural adaptation2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
,2626. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...
.

For internal consistency, the majority of the studies did not report factorial analysis or unidimensionality study of the items2121. Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018. PMid:21203696.
http://dx.doi.org/10.1590/S1413-35552010...
,2222. Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012. PMid:20339653.
http://dx.doi.org/10.1590/S0004-282X2010...
,2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.

29. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.
-3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
. These analyses are important because they intend to verify the number of dimensions into which the items are distributed and whether subscales are formed in the instrument. The only instrument to present the unidimensionality through the Rasch analysis, the (MAL)1818. Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011. PMid:22069074.
http://dx.doi.org/10.1590/S1020-49892011...
,1919. Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112., included an inadequate number of participants1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

In terms of internal consistency, a sample of 7 participants is indicated for each item of the instrument, requiring a minimum of 100. For example, for an instrument of 30 items, a sample of 210 would be indicated1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
. It is recommended that internal consistency should be assessed in two ways: through the classic form, or by the item response theory. First, Cronbach's alpha should be calculated after the performance of the factorial analysis, which identifies the number of subscales where the alpha must be calculated1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
. Second, the Rasch mathematical model is indicated to assess the unidimensionality of the items, verifying the presence of items that can be adjusted or removed from the instrument1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

The flaws observed in the construct validity of the instruments2020. Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012.
http://dx.doi.org/10.1590/S1413-35552008...
,2525. Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918. PMid:19039215.
http://dx.doi.org/10.1159/000177918...
,2626. Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034. PMid:17119821.
http://dx.doi.org/10.1590/S0004-282X2006...
,2828. Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.

29. Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.
-3030. Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006.
http://dx.doi.org/10.1590/S1809-29502008...
generate uncertainties about the degree to which the Brazilian versions of the included instruments truly measure the correct construct. It is recommended that 100 participants be assessed and that hypotheses be previously formulated about the direction and magnitude of the expected correlation between the scores of the tested instruments and the comparator instrument1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.The responsiveness and the criterion validity were not analyzed in any of the studies. The criterion validity is analyzed to verify the degree with which the scores of the instruments are an adequate reflection of the "gold-standard". However, for motor function measurement, no such instrument was observed in Brazil.

The absence of the responsiveness study, observed in all of the instruments, hampers the identification of the ability of these instruments to detect changes in the assessed construct over time. Therefore, there is no evidence that it will be possible to quantify any motor function changes in post-stroke individuals in clinical research1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
.

Finally, the interpretability of the obtained scores in these instruments still has not been clarified. Despite the fact that the ceiling and floor effects in the Posture Assessment Scale and Trunk Deficiency Scale were analyzed and had favorable results, the sample size in both studies was inadequate. None verified the minimum important change (MIC) or the minimum important difference (MID). These results are relevant because the MIC is the smallest change in the construct score the patients observe as important and the MID corresponds to the minimum difference in the construct among patients that is considered important1414. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8. PMid:20169472.
http://dx.doi.org/10.1007/s11136-010-960...

15. Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
-1616. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006. PMid:20494804.
http://dx.doi.org/10.1016/j.jclinepi.201...
. None of the instruments were tested for their interpretability and responsiveness. As such, it remains unknown whether these instruments are able of measuring clinical changes over time.

Final considerations

Future studies should revise the cross-cultural adaptation processes, following all of the recommended stages (translation, synthesis of translations, back translation, expert committee, and pre-test). Moreover, the measurement properties should be analyzed with an adequate number of participants and the application of statistical methods that reflect the validity of each property. The results of this review point out that health professionals must be cautious when selecting instruments to assess post-stroke motor function for use in research and clinical practice in Brazil.

References

  • 1
    Soriano FFS, Baraldi K. Escalas de avaliação funcional aplicáveis a pacientes pós- Acidente Vascular Encefálico. Con Scientia e Saúde. 2010;9(3):521-30.
  • 2
    Pomeroy VM, King LM, Pollock A, Alison B, Peter L. Electrostimulation for promoting recovery of movement or functional ability after stroke. Cochrane Database Syst. Rev. 2006(2):1-74. http://dx.doi.org/10.1002/14651858.CD003241.pub2
    » http://dx.doi.org/10.1002/14651858.CD003241.pub2
  • 3
    Pollock A, Gill B, Pomeroy VM, Langhorne P. Physiotherapy treatment approaches for the recovery of postural control and lower limb function following stroke. Cochrane Database Syst. Rev. 2007(1):1-92. http://dx.doi.org/10.1002/14651858.CD001920.pub2
    » http://dx.doi.org/10.1002/14651858.CD001920.pub2
  • 4
    Leitão A. Manual da Classificação Internacional da Funcionalidade Incapacidade e Saúde (CIF). Lisboa: OMS; 2004.
  • 5
    Falcão IV, Carvalho EMF, Barreto KML, Lessa FJD, Leite VMM. Acidente Vascular Cerebral precoce: implicações para adultos em idade produtiva atendidos pelo Sistema Único de Saúde. Rev Bras Saude Mater Infant. 2004;4(1):95-102. http://dx.doi.org/10.1590/S1519-38292004000100009
    » http://dx.doi.org/10.1590/S1519-38292004000100009
  • 6
    Ferreira LTD, Pinto EB. Perfil Funcional dos pacientes acometidos por acidente vascular encefálico de um centro de referência em Salvador. Fisioter Bras. 2008;9(2):81-5.
  • 7
    Hendricks HT, van Limbeek J, Geurts AC, Zwarts MJ. Motor Recovery after Stroke: A systematic Review of the Literature. Arch Phys Med Rehabil. 2002;83(11):1629-37. http://dx.doi.org/10.1053/apmr.2002.35473 PMid:12422337.
    » http://dx.doi.org/10.1053/apmr.2002.35473
  • 8
    Ceccato RB, Almeida CI. O planejamento da reabilitação na fase aguda após acidente vascular encefálico. Acta Fisiátrica. 2010;17(1):33-47.
  • 9
    Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186-91. http://dx.doi.org/10.1097/00007632-200012150-00014 PMid:11124735.
    » http://dx.doi.org/10.1097/00007632-200012150-00014
  • 10
    Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94-104. http://dx.doi.org/10.1111/j.1524-4733.2005.04054.x PMid:15804318.
    » http://dx.doi.org/10.1111/j.1524-4733.2005.04054.x
  • 11
    Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34-42. http://dx.doi.org/10.1016/j.jclinepi.2006.03.012 PMid:17161752.
    » http://dx.doi.org/10.1016/j.jclinepi.2006.03.012
  • 12
    Kirshner B, Guyatt G. A Methodological framework for assessing health indices. J Chronic Dis. 1985;38(1):27-36. http://dx.doi.org/10.1016/0021-9681(85)90005-0 PMid:3972947.
    » http://dx.doi.org/10.1016/0021-9681(85)90005-0
  • 13
    Terwee CB, Jansma EP, Riphagen II, De Vet HC. Development of a methodological PubMed search filter for finding studies on measurement properties of measurements instruments. Qual Life Res. 2009;18(8):1115-23. http://dx.doi.org/10.1007/s11136-009-9528-5 PMid:19711195.
    » http://dx.doi.org/10.1007/s11136-009-9528-5
  • 14
    Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539-49. http://dx.doi.org/10.1007/s11136-010-9606-8 PMid:20169472.
    » http://dx.doi.org/10.1007/s11136-010-9606-8
  • 15
    Mokink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;(10):22.
  • 16
    Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology and definitions of measurements properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45. http://dx.doi.org/10.1016/j.jclinepi.2010.02.006 PMid:20494804.
    » http://dx.doi.org/10.1016/j.jclinepi.2010.02.006
  • 17
    Pereira ND, Michaelsen SM, Menezes IS, Ovando AC, Lima RC, Teixeira-Salmela LF. Reliability of the Brazilian version of the Wolf Motor Function Test in adults with hemiparesis. Rev Bras Fisioter. 2011;15(3):257-65. http://dx.doi.org/10.1590/S1413-35552011000300013 PMid:21829991.
    » http://dx.doi.org/10.1590/S1413-35552011000300013
  • 18
    Saliba VA, Magalhães LC, Faria CDCM, Laurentino GE, Cassiano JG, Teixeira-Salmela LF. Adaptação Transcultural e análise das propriedades psicométricas da versão brasileira do instrumento Motor Activity Log. Rev Panam Salud Publica. 2011;30(3):262-71. http://dx.doi.org/10.1590/S1020-49892011000900011 PMid:22069074.
    » http://dx.doi.org/10.1590/S1020-49892011000900011
  • 19
    Pereira ND, Ovando AC, Michaelsen SM, Anjos SM, Lima RCM, Nascimento LR, et al. Motor Activity Log-Brasil: reliability and relationships with motor impairments in individuals with chronic stroke. Arq Neuropsiquiatr. 2012;70(3):196-201. PMid:22392112.
  • 20
    Michaelsen SM, Natalio MA, Silva AG, Pagnussat AS. Reliability of the translation and adaptation of the Test d'Évaluation des Membres Supérieurs des Personnes Âgées (TEMPA) to the Portuguese language and validation for adults with hemiparesis. Rev Bras Fisioter. 2008;12(6):511-9. http://dx.doi.org/10.1590/S1413-35552008005000012
    » http://dx.doi.org/10.1590/S1413-35552008005000012
  • 21
    Ferreiro KN, Santos RL, Conforto AB. Psychometrics properties of the Portuguese version of the Jebsen-Taylor test for adults with mild hemiparesis. Rev Bras Fisioter. 2010;14(5):377-82. http://dx.doi.org/10.1590/S1413-35552010005000018 PMid:21203696.
    » http://dx.doi.org/10.1590/S1413-35552010005000018
  • 22
    Pavan K, Cruz LC, Nunes MF, Menezes LG, Marangoni BE. Cross-cultural adaptation and validation of the Rivermead Mobility Index in stroke patients within the Brazilian cultural and language context. Arq Neuropsiquiatr. 2010;68(1):52-5. http://dx.doi.org/10.1590/S0004-282X2010000100012 PMid:20339653.
    » http://dx.doi.org/10.1590/S0004-282X2010000100012
  • 23
    Michaelsen SM, Rocha AS, Knabben RJ, Rodrigues LP, Fernandes CGC. Translation, adaptation and inter-rater reliability of the administration manual for the Fugl-Meyer assessment. Rev Bras Fisioter. 2011;15(1):80-8. http://dx.doi.org/10.1590/S1413-35552011000100013 PMid:21519719.
    » http://dx.doi.org/10.1590/S1413-35552011000100013
  • 24
    Maki T, Quagliato EMAB, Cacho EWA, Paz LPS, Nascimento NH, Inoue MMEA, et al. Estudo de Confiabilidade da aplicação da escala de Fugl-Meyer no Brasil. Rev Bras Fisioter. 2006;10(2):177-83. http://dx.doi.org/10.1590/S1413-35552006000200007
    » http://dx.doi.org/10.1590/S1413-35552006000200007
  • 25
    Cincura C, Pontes-Neto OM, Neville IS, Mendes HF, Menezes DF, Mariano DC, et al. Validation of the National Institutes of health stroke scale, Modified Rankin Scale and Barthel Index in Brazil: The role of cultural adaptation and structured interviewing. Cerebrovasc Dis. 2009;27(2):119-22. http://dx.doi.org/10.1159/000177918 PMid:19039215.
    » http://dx.doi.org/10.1159/000177918
  • 26
    Caneda MAG, Fernandes JG, Almeida AG, Mugnol FE. Confiabilidade de escalas de comprometimento neurológico em pacientes com acidente vascular cerebral. Arq Neuropsiquiatr. 2006;64(3A):690-7. http://dx.doi.org/10.1590/S0004-282X2006000400034 PMid:17119821.
    » http://dx.doi.org/10.1590/S0004-282X2006000400034
  • 27
    Conte ALF, Ferrari PP, Carvalho TB, Relvas PCA, Neves RCM, Rosa SF. Reliability, comprehension and acceptability of the Portuguese version of the Motor Assessment Scale in stroke patients. Rev Bras Fisioter. 2009;13(5):405-11. http://dx.doi.org/10.1590/S1413-35552009005000056
    » http://dx.doi.org/10.1590/S1413-35552009005000056
  • 28
    Yoneiama SM, Roiz RM, Oliveira TM, Oberg TG, Lima NMFV. Validação da versão brasileira da Escala de avaliação postural para pacientes após acidente vascular encefálico. Acta Fisiatr. 2008;15(2):96-100.
  • 29
    Castelassi CS, Ribeiro EAF, Fonseca VC, Beinotti F, Oberg TD, Lima NMFV. Confiabilidade da versão brasileira da escala de deficiências de tronco em hemiparéticos. Fisioter Mov. 2009;22(2):189-99.
  • 30
    Lima NMFV, Rodrigues SY, Fillipo TM, Oliveira R, Oberg TG, Cacho EWA. Versão brasileira da Escala de Comprometimento do tronco: um estudo de validade em sujeitos pós-acidente vascular encefálico. Fisioter Pesqui. 2008;16(3):248-53. http://dx.doi.org/10.1590/S1809-29502008000300006
    » http://dx.doi.org/10.1590/S1809-29502008000300006
  • 31
    Benaim C, Pérennou DA, Villy J, Rousseaux M, Pelissier JY. Validation of a standardized assessment of postural control in stroke patients: the Postural Assessment Scale for Stroke Patients (PASS). Stroke. 1999;30(9):1862-8. http://dx.doi.org/10.1161/01.STR.30.9.1862 PMid:10471437.
    » http://dx.doi.org/10.1161/01.STR.30.9.1862
  • 32
    Fujiwara T, Liu M, Tsuji T, Sonoda S, Mizuno K, Akaboshi K, et al. Development of a new measure to assess trunk impairment after stroke (Trunk Impairment Scale): its psychometric properties. Am J Phys Med Rehabil. 2004;83(9):681-8. http://dx.doi.org/10.1097/01.PHM.0000137308.10562.20 PMid:15314532.
    » http://dx.doi.org/10.1097/01.PHM.0000137308.10562.20
  • 33
    Verheyden G, Nieuwboer A, Mertin J, Preger R, Kiekens C, De Weerdt W. The trunk impairment scale: a new tool to measure motor impairment of the trunk after stroke. Clin Rehabil. 2004;18(3):326-34. http://dx.doi.org/10.1191/0269215504cr733oa PMid:15137564.
    » http://dx.doi.org/10.1191/0269215504cr733oa
  • 34
    Fugl-Meyer AR, Jaasko L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient: 1. A method for evaluation of physical performance. Scand J Rehabil Med. 1975;7(1):13-31. PMid:1135616.
  • 35
    Jebsen RH, Taylor N, Trieschmann RB, Trotter MJ, Howard LA. An objective and standardized test of hand function. Arch Phys Med Rehabil. 1969;50(6):311-9. PMid:5788487.
  • 36
    Carr JH, Shepherd RB, Nordholm L, Lynne D. Investigation of a new motor assessment scale for stroke patients. Phys Ther. 1985;65(2):175-80. PMid:3969398.
  • 37
    Uswatte G, Taub E, Morris D, Light K, Thompson PA. The Motor Activity Log-28: assessing daily use of the hemiparetic arm after stroke. Neurology. 2006;67(7):1189-94. http://dx.doi.org/10.1212/01.wnl.0000238164.90657.c2 PMid:17030751.
    » http://dx.doi.org/10.1212/01.wnl.0000238164.90657.c2
  • 38
    Brott TG, Adams HP Jr, Olinger CP, Marler JR, Barsan WG, Biller J, et al. Measurements of acute cerebral infarction: a clinical examination scale. Stroke. 1989;20(7):864-70. http://dx.doi.org/10.1161/01.STR.20.7.864 PMid:2749846.
    » http://dx.doi.org/10.1161/01.STR.20.7.864
  • 39
    Collen FM, Wade DT, Robb GF, Bradshaw CM. The Rivermead Mobility Index: a further development of the Rivermead Motor Assessment. Int Disabil Stud. 1991;13(2):50-4. http://dx.doi.org/10.3109/03790799109166684 PMid:1836787.
    » http://dx.doi.org/10.3109/03790799109166684
  • 40
    Desrosiers J, Hébert R, Dutil E, Bravo G. Development and reliability of an upper extremity function test for the elderly: the TEMPA. Can J Occup Ther. 1993;60(1):9-16. http://dx.doi.org/10.1177/000841749306000104
    » http://dx.doi.org/10.1177/000841749306000104
  • 41
    Morris DM, Uswatte G, Crago JE, Cook EW 3rd, Taub E. The reliability of the wolf motor function test for assessing upper extremity function after stroke. Arch Phys Med Rehabil. 2001;82(6):750-5. http://dx.doi.org/10.1053/apmr.2001.23183 PMid:11387578.
    » http://dx.doi.org/10.1053/apmr.2001.23183

Publication Dates

  • Publication in this collection
    15 Mar 2016
  • Date of issue
    Mar-Apr 2016

History

  • Received
    16 Apr 2015
  • Reviewed
    12 Aug 2015
  • Accepted
    26 Aug 2015
Associação Brasileira de Pesquisa e Pós-Graduação em Fisioterapia Rod. Washington Luís, Km 235, Caixa Postal 676, CEP 13565-905 - São Carlos, SP - Brasil, Tel./Fax: 55 16 3351 8755 - São Carlos - SP - Brazil
E-mail: contato@rbf-bjpt.org.br