Intra-rater and Inter-rater Reliability of Hemoglobin Color Scale Method

Sir, Anemia during pregnancy is a major public health problem in Sri Lanka as well as in other developing countries. The clinical method of detecting anemia is having a low accuracy.(1,2) The National Maternal and Child Health Program — Sri Lanka, has introduced the Hemoglobin Color Scale (HCS) to assess Hb levels in field clinics since 2007. The HCS test has been developed by the WHO, as it is a simple, reliable, and inexpensive method of diagnosing anemia when laboratory methods are not freely available.(3) The objective of the present study is to test the intraand inter-rater reliability of HCS tests in the actual field setting.


Intra-rater and Inter-rater Reliability of Hemoglobin Color Scale Method
Sir, Anemia during pregnancy is a major public health problem in Sri Lanka as well as in other developing countries. The clinical method of detecting anemia is having a low accuracy. (1,2) The National Maternal and Child Health Program -Sri Lanka, has introduced the Hemoglobin Color Scale (HCS) to assess Hb levels in field clinics since 2007. The HCS test has been developed by the WHO, as it is a simple, reliable, and inexpensive method of diagnosing anemia when laboratory methods are not freely available. (3) The objective of the present study is to test the intra-and inter-rater reliability of HCS tests in the actual field setting.
We conducted the present study in Kalutara district, Sri Lanka. Five randomly selected pregnant mothers were invited for the study. Five public health midwives (PHMM) from the field were selected randomly and invited for the study. We used a balanced randomized block design, with repeated observations, for reliability testing. A single mother was tested using five strips. Reading of Hb values were done by PHMM who were blinded for the identity of strips. Five Hb strips representing all five subjects were given to each PHMM for recording of HB values. Strip sets were exchanged and reread by different PHMMs. The same two sets they already observed were given to them for a repeated reading without their knowledge.
One hundred readings were obtained in all. A single PHMM recorded four readings [two repetitive readings] for a subject, thus 20 recordings for all five subjects. Readings were completed within five minutes. Percentage agreement between two readings for an individual PHMM varied from 20 to 90%. Table 1 shows the various measures of intra-rater reliability.
Variance of the repeated reading shows wide variation, that is, 0789 to 2.221 between PHMMs. Only two observers had very good Intraclass Correlation Coefficient (ICC) (0.757), which was highly significant (P = 0.004). One observer reported non-significant poor correlation (ICC 0.301, P = 0.184), while two remaining observers reported no correlation at all between repeated readings.
ICC for test / retest reliability for strips was 0.162, where the correlation was very poor and not significant (P = 0.699). Repeated measure analysis of variance (ANOVA) showed highly significant differences between observers (F = 10.05, P < 0.001) and negative ICC value (-0.047), which indicated that there was no correlation at all between the observers.
Our study showed that the inter-rater and intra-rater reliability was very poor for HCS, among our study sample. However, previous studies have shown that the HCS test has high reliability and validity. (4) The present study was conducted in a natural field setting, during their routing procedures, to resemble the actual environment dinal changes in energy expenditure in girls from late childhood through midadolescence. Am J Clin Nutr 2005;81:1102-9. where they usually apply this test. Following of standard procedure was not observed because our prime objective was to assess the present practice. These limitations might have an impact on our observations.
Retraining of PHMM in a standard procedure and identification of PHMM with reliable strip reading capabilities and allocation of the task only to those, would help to overcome this problem. However, the study was a preliminary study. Generalization of the findings cannot be done due to limitation in the study.
A study with properly calculated sample size, with an adequate number of pregnant mothers representing a wide range of HB levels is recommended.
Sir, We conducted a household-based cross-sectional study in a purposively selected slum (population: 70 000) of North-East Delhi in August, 2008. The respondents comprised 230 adult females who were involved in cooking food. The sample size of 230 was derived using the following parameters: 50% prevalence, 95% confidence interval, ± 10% confidence interval width, design effect of one, and 5% non-response rate. As no prior estimates of levels of consumption of iodized salt in the studied slum were available, we assumed 50% prevalence. The slum, being large and heterogeneous, was divided into 10 strata. The 10 strata were also the 10 catchment areas of the ASHA workers. Twentythree respondents were identified in each strata using systematic random sampling methodology.
Using a pre-tested interview schedule, the following aspects were enquired from the respondentsbackground characteristics, type of cooking salt that they predominantly use; reasons for the same and awareness about the benefits of iodized salt. Iodine content of the cooking salt consumed was tested using a rapid iodine field-testing kit using similar standard procedures, used in the Third National Family Health Survey. (1) Most (209) households consumed packed refined salt.
Only 21 households consumed unpacked crystalline salt (nonpowdered: 19; powdered: 2). The various reasons reported by households consuming crystalline salt (21) included 'low cost' (8), 'since it tasted better' (9) and 'feeling it is pure and uncontaminated unlike refined salt' (4). The value in parenthesis indicates the number of households. Out of those households consuming refined salt (209), 130 consumed it to save time and avoid the inconvenience of grinding crystalline salt, but opted for cheaper varieties owing to low purchasing power.
Other reasons reported for consuming refined salt were as follows: better taste and appearance (45), free flowing (24), and influence of television advertisements (10).
A total of 174 out of 230 households were consuming adequately iodized salt (≥15 ppm iodine) [ Table 1]. Awareness about health benefits of iodized salt was extremely poor and seen in only 15 out of 230 respondents. Yet on the positive side, all 15 households who were aware of the benefits of consumption of iodized salt were consuming adequately iodized salt. Consumption of adequately iodized salt was higher among households consuming refined salt as compared to those consuming crystalline salt. However, even among households consuming refined salt (209), 36