Diagnostic Value of Pancreatic Stone Protein in comparison to White Cell Count and C-Reactive Protein in the Diagnosis of Acute Appendicitis – A Prospective Multicenter Diagnostic Accuracy Trial

Background: Acute appendicitis is a common cause of acute abdominal pain and remains a diagnostic challenge. In the search for improved diagnostic characterization, the authors aimed at determining the diagnostic accuracy of Pancreatic Stone Protein (PSP), in predicting acute appendicitis. Methods: The “PSP Appendix Trial” is a prospective, international, multicenter, diagnostic accuracy study, including consecutive patients with a clinical suspicion of acute appendicitis. The index test was PSP and its diagnostic accuracy was compared to White Blood Cell Count (WBC), C-Reactive Protein (CRP), the Alvarado score, Ultrasound (US) and Computer Tomography (CT) for appendicitis evident on histology. (NCT01610193) Results: A total of 357 patients presented with clinical suspicion of acute appendicitis, of whom 301 (84%) were admitted to the hospital, 230 (64%) were operated, and 194 (54%) were diagnosed with acute appendicitis on histology. Of all tests, low PSP values of <40ng/ml had the highest accuracy (84%, p<0.001) in predicting appendicitis on histology when compared to the Alvarado score >6 (60%, p=0.132), WBC > 10G/l (74%, p=0.250), CRP >5 mg/l (67%, p=0.299), ultrasound (67%, p=0.023) and CT (83%, p= N/A). Conclusion: In contrast with our initial hypothesis, higher PSP levels were associated with the likelihood of having complex diagnosis, more complex than acute appendicitis. Using a cut-off value of 40ng/ml (when <40/positive), PSP had the highest accuracy in predicting appendicitis on histology when compared to the Alvarado score, CRP, US and CT. Integration of PSP in the differential diagnosis of right iliac fossa pain may provide useful information to decide whether appendicitis was accompanied by surgically more complicated situations. Low values were an indicator for straight surgical appendicitis. Citation: Raptis DA, Dilmurodjon E, Tschuor C, Limani P, Neff T, et al. (2019) Diagnostic Value of Pancreatic Stone Protein in comparison to White Cell Count and CReactive Protein in the Diagnosis of Acute Appendicitis – A Prospective Multicenter Diagnostic Accuracy Trial. J Surg 3: 1201. DOI: 10.29011/2575-9760.001201 2 Volume 3; Issue 02 J Surg, an open access journal ISSN: 2575-9760


Introduction
Appendicitis is a common condition that necessitates urgent surgery.It may present with a variety of clinical manifestations often overlapping with other common clinical entities of abdominal pain, while delay in diagnosis increases significantly the morbidity rates resulting to even potentially life threating complications if left untreated on time.Despite diagnostic and therapeutic advancement in recent years, the diagnosis of acute appendicitis remains mainly clinical [1].White Blood Cell count (WBC) and C-Reactive Protein (CRP) vary significantly depending on the duration of symptoms.Based on current diagnostic strategies, a misdiagnosis rate of 5-15% is still reported [1,2].
In search for novel inflammatory markers, the authors came across Pancreatic Stone Protein (PSP), a secretory protein produced predominantly in the pancreas and the gut.There is evidence from experimental and clinical trials that the levels of PSP in the blood increase in the presence of inflammation or infection [3,4].PSP was shown in a population of patients with sepsis-related complications to have a high diagnostic accuracy in discriminating the severity of peritonitis and predicting mortality in the Intensive Care Unit (ICU) [5].Furthermore, PSP was identified as a biomarker related to organ failure and outcome in patients with ventilator associated pneumonia [4].However, it is unknown whether PSP is similarly superior to WBC or CRP in predicting appendicitis.The objective of this trial is to determine the diagnostic accuracy of PSP in predicting acute appendicitis and to compare PSP with other established markers used in the diagnostic work-up.

Study Design
The "PSP Appendix Trial" was a prospective, multi-center, diagnostic accuracy cohort study designed to assess the value of PSP in the diagnostic workup of acute appendicitis.The local ethics committee has approved the study protocol.The study protocol was registered at ClinicalTrials.gov[NCT01610193] as well as published in advance [6].The authors used the STARD checklist [7] for reporting the findings.

Participants
All consecutive adult patients who presented with right iliac fossa pain and a clinical suspicion of acute appendicitis, qualified for study inclusion.This study was designed to be a pragmatic trial and thus recruitment was based upon the clinical judgment of the surgeons.All patients who fulfilled the inclusion criteria but refused study participation as well as patients who were not primarily detected as eligible patients were excluded from the study and were recorded.Study recruitment started on the 28 th of February 2012 and ended on the 17 th of November, 2015.

Test Methods
The index test was PSP value, a peripheral blood test obtained from all patients with a clinical suspicion of appendicitis upon attendance at the Emergency Department (ED).At the same time, blood samples were obtained among others, for WBC and CRP, as routinely performed in all patients with abdominal pain.Additionally, the clinical parameters for the Alvarado likelihood of appendicitis score [8] (Table 2) were collected, including recording of relevant symptoms related to appendicitis.Abdominal Ultrasound Scan (USS) and Computed Tomography (CT) were freely performed according to the routine decision of the investigators.Imaging according to the final reports were recorded and used for further diagnostic accuracy analysis.In a first analysis (A) including all patients with clinical suspicion of appendicitis, the reference standard was the "diagnosis of appendicitis" or "no appendicitis" (dichotomous variable) upon discharge of the patient, judged either directly at admittance from the emergency room, or during the entire course of the hospitalization upon discharge.The diagnosis of appendicitis was based either on clinical or imaging criteria, if discharged from the emergency room or the hospital ward.Thus, all patients, even those who did not undergo surgery, had an assessment with regard to the diagnosis of appendicitis and an initial analysis of PSP in the emergency room setting at hospital admittance (Figure 1).In a second analysis (B), focusing on the primary endpoint of this study, the reference standard was the presence or absence of appendicitis based on the definitive histopathological report (Figure 1).Thus, this cohort included only patients who had the appendix removed.The optimal cut-off values for test positivity for PSP, WBC and CRP were determined by performing ROC curve analysis and based on the Youden's index, known to give equal weight to sensitivity and specificity, as previously described [5].The investigators were blinded to the PSP values obtained from the patients.However, WBC and CRP values were performed at the local laboratories and were immediately available to the investigators.The blood samples obtained for PSP measurements were separately stored and analyzed using the ELISA technique [5].

Data Collection
The assessment for patient recruitment started as soon as the patient entered ED.If there was a clinical suspicion for appendicitis, the patient was further assessed for eligibility to participate in the study.Once a patient was found to meet the study inclusion criteria, the patient entered immediately the trial before any other investigations were ordered.Data collection included basic demographics, clinical status, laboratory values, the use and the findings of diagnostic imaging, whether the patients were discharged from ED at home, admitted to the ward or referred to another medical team.During hospitalization, data regarding medical or surgical treatment, the operation type and findings, and any complications using the Clavien-Dindo Classification of surgical complications [9] as well as the Comprehensive Complications Index ® (CCI ® ) [10,11] were recorded.Finally, the histopathology reports of operated patients were also recorded.Data capture in this multicenter trial occurred with the use of a specially designed (by DAR), encrypted and password protected, electronic Clinical Trial Management System (CTMS) [https://www.PSPtrial.com],as previously described [12].

Sample size
Due to the lack of data in the literature on PSP levels in patients with appendicitis, a sample size calculation was performed to ensure an adequate event rate, i.e. appendicitis on histology in patients that were operated, of over 100 patients.Assuming a negative appendectomy rate, i.e. appendices surgically removed but normal on histopathology, of 15%, hence 85% of patients with appendicitis, an effect size difference of 0.80, an alpha error of 0.05, a power of 80%, and an allocation ratio of 0.185, a total of 130 patients undergoing appendectomy were needed.Thus, assuming 20% of patients admitted but not operated and 20% of patients presenting to the emergency room but discharged home, a total of 204 patients were needed to be recruited for the study.To adjust for loss to follow up or missing values, at least 245 patients were estimated for study inclusion, as previously reported [6].

Statistical Analysis
Continuous variables were compared with the Student t, Mann-Whitney U, one-way ANOVA, and Kruskal-Wallis tests, where appropriate.Differences among proportions derived from categorical data were compared using the Fischer's Exact or the Pearson χ2 tests, where appropriate.All p values were two-sided and considered statistically significant if p≤0.05.Sensitivity, specificity, accuracy, Positive Predictive Value (PPV), Negative Predictive Value (NPV), Positive Likelihood Ratio (PLR), Negative Likelihood Ratio (NLR), Yuden's Index (YI), diagnostic Odds Ratio (OR), and the Receiver Operator Characteristic (ROC) curve were also calculated.For better interpretation of the different diagnostic accuracy results, the arbitrary scale was used with a value of >0.81 being very high, 0.61 -0.80 high, 0.41 -0.60 moderate, 0.21 -0.40 low, and 0.01 -0.20 very low.Data are presented as mean (SD), median (i.q.r.) and proportions (%) with odds ratios (95% CI), where appropriate.Statistical analysis was performed using R version 3.

What were the characteristics of the patients?
A total of 357 eligible patients (167 males, 190 females) presented at the emergency room with abdominal pain and clinical suspicion of appendicitis.Tables 1,2  characteristics.Blood samples were obtained from all patients with a mean WBC of 12.5±4.3x10 9/l and a mean CRP of 43.9±53.5 mg/l.The mean Pancreatic Stone Protein (PSP) values, was 37±67ng/ml Table 3  USS was performed in 263 (73.7%) and CT in 53 (14.8%) patients.In 29 (9%) patients, USS was not conclusive, and therefore followed by an additional CT.Majority of USS were performed in women (150/171, 88%) as compared to men (113/152, 74%) (OR 2.5 (1.3-4.7),p=0.003), while CT were more equally distributed between genders (29/171, 17%, vs. 24/152, 16%, (OR 2.6 (1.3-4.66),p=0.881).Of all 357 patients who presented at the emergency room, 56 (16%) were discharged directly after initial assessment, while 301 (84%) were admitted to the hospital ward.Re-attendance to the emergency room later than one day after primary discharge at home occurred in 19 (5%) patients, 7 of whom were diagnosed subsequently with appendicitis after reevaluation.The final diagnoses of the 56 patients upon discharge directly from the emergency room on the same day are listed in Supplementary Table S1.

How were the hospitalized patients managed?
Hospitalization was defined as any patient being admitted from the emergency room directly to the theatre room or to the hospital ward.Of the 301 patients admitted, 230 (76%) received surgery, while 127 (32%) were treated conservatively.Supplementary Table S2 lists the operation characteristics of the participants.Of all 230 operated patients, diagnosis of acute appendicitis was confirmed intraoperatively and on the histopathology report in 194 (84%) patients (194/357, 54% for the whole cohort).Furthermore, of the 230 operated patients, 219 (95%) had their appendix removed while the remaining 11 (5%) received another operation without appendectomy.In these 11 patients, appendicitis was excluded preoperatively with CT and the indication for surgery was not appendicitis.Of the 219 patients who received an appendectomy, 194 (89%) had appendicitis confirmed based on histology of the removed specimen while the remaining 25 had no evidence of appendicitis.Thus, the negative appendectomy (i.e.appendectomy normal in the histopathology report) rate was 11% (25/219) in our series Supplementary Table S3. Figure 1

What was the diagnostic value of the Alvarado likelihood score in the diagnosis of acute appendicitis?
The Alvarado likelihood score for acute appendicitis, including common symptoms, signs, WBC and neutrophils was completed in all patients as soon as they were enrolled to the trial (Table 2).Of all 357 patients, 201 (56%) had a low (score 0-6) while 156 (44%) had a high likelihood of acute appendicitis score (score 7-10).In the 194 patients with acute appendicitis, 118 (61%) had a high Alvarado score while 76 (39%) had a low score.In the 163 patients without appendicitis, the Alvarado score was high in 38 (23%) patients and low in the remaining 125 (77%) patients (OR 5.1,p<0.001).The diagnostic accuracy based on the ROC curve analysis of the Alvarado score (low vs. high) is indicated in Table 5, with an accuracy of 68% (p<0.001).

What was the diagnostic value of WBC, CRP and PSP in the diagnosis of appendicitis?
Blood for measurement of WBC, CRP and PSP was obtained from all 357 patients, early during their attendance at the emergency room (Table 3).The mean WBC count in patients with acute appendicitis was 13±4.3x10 9 /l and in patients without appendicitis (or any other condition) was 11±4.1x10 9 /l (p<0.001).The mean CRP in patients with appendicitis was 47±52 mg/l and those without (or any other condition) was 40±56mg/l (p=0.248).The mean PSP in patients with appendicitis was 25±33 ng/ml while in patients without appendicitis (or any other condition) was surprisingly higher, with a mean of 51±91ng/ml (p<0.001)(Figure 2).Thus, based on these findings, the authors decided to change the test positivity when PSP was lower and negative when higher.The accuracy for acute appendicitis was moderate regarding WBC>10x10 9 /l, CRP>5 mg/l and PSP<40 ng/ml, with 66%, 66% and 61%, respectively Table 5, Figure 3.

What was the diagnostic value of USS and CT in the diagnosis of appendicitis?
The use of diagnostic imaging methods, USS and CT, and their respective findings are reported in Table 4.The accuracy of ultrasound performed by radiologists at the emergency room for the diagnosis acute appendicitis was 77%, with a sensitivity of 89% and specificity of 66% (p<0.001 for the Area Under the Curve (AUC)).The accuracy of CT was as expected higher at 91% as compared to ultrasound, with a sensitivity of 83% and specificity as high as 100% (p<0.001 for the AUC) (Table 5).

What is the value of PSP in the differential diagnosis of right iliac fossa pain?
As mentioned above, PSP was higher in the patient group without appendicitis and any other condition causing right iliac fossa pain.In the 61 patients with a PSP value of >40 ng/ml, 20 (33%) were diagnosed with appendicitis while in the 293 patients with PSP <40, 174 (59%) had appendicitis (p<0.001)(Table 3, Figure 4).Thus, a PSP value higher than 40 ng/ml, indicates a lower likelihood for appendicitis in patient with right iliac fossa pain.In an attempt to improve the Alvarado likelihood score for acute appendicitis, PSP was included into the score by simply adding an additional point when PSP was less than 40 ng/ml.In 76% of the patients with appendicitis, the Alvarado score was more than 6.When PSP was added to the score, 85% of patients with appendicitis, demonstrated a positive score (p<0.001)(Figure 5).Thus, when PSP is more than 40 ng/ml, the diagnosis of appendicitis is less likely and further investigations, such as computer tomography, would be needed before the decision to operate.The only laboratory value obtained at the emergency room that could discriminate appendicitis from a normal appendix on histology was PSP, with 92% (174/189) of patients with a PSP <40 ng/ml having appendicitis and only 8% (15/189 PSP<40) of patients with a PSP >40 ng/ml having appendicitis (p<0.001)(Figure 6).Of the 30 patients who underwent CT and an appendectomy, 25 (83%) were correctly predicted with appendicitis while in 5 patients (17%), CT missed appendicitis (Table 6).Of all tests, PSP <40 ng/ml had the highest accuracy (84%, p<0.001) in predicting appendicitis on histology when compared to the Alvarado score>6 (60%, p=0.132),WBC > 10 x 10 9 /l (74%, p=0.122),CRP >5 mg/l (75%, p=0.299), ultrasound (67%, p=0.023) and CT (83% p=n/a) (Table 6).

Discussion
The present study found that in patients with a suspicion of appendicitis, higher PSP levels are associated with less likelihood of having the suspected clinical entity.Inclusion of PSP levels in the Alvarado score seem to further improve its known predictive value.With a cut-off level of 40 ng/ml (when <40/positive), PSP had the highest accuracy of 84% in predicting appendicitis on histology when compared to the Alvarado score, CRP, USS and CT.PSP were first discovered in patients with chronic pancreatitis [14] and is transiently elevated in patients with pancreatitis [15].The protein is localized to the acinar cells of the pancreas [16].As an acute-phase protein regulated by IL-6 and other cytokines, PSP is released after tissue injury.Studies in animal models revealed, that PSP is released upon stress even in the absence of chronic or acute pancreatitis.To a lower extent, PSP is also synthetized in the Paneth cells of the small intestine [17] and the fundus of the stomach while it is not produced in the colon and the appendix [18,19].The fact that PSP is neither produced in the colon nor the appendix may explain why PSP is elevated in conditions such as gastroenteritis or gastritis but not elevated during appendicitis.In fact, PSP best excluded the diagnosis of appendicitis and therefore may reduce the negative appendectomy rate if integrated in the routine work-up.
WBC is useful in predicting appendicitis combined with the history and the clinical presentation [20].The acute phase protein CRP increases with some delay and is a predictor for complicated appendicitis.However, studies have reported normal WBC levels and normal CRP levels in up to 10% of patient with histologically proven appendicitis [21].Since normal inflammatory markers cannot exclude appendicitis, it still remains a primarily clinical diagnosis.This is taken into consideration in the Alvarado score.The Alvarado score was implemented in 1986 aiming for early diagnosis in patients with suspicion for appendicitis.It was modified in order to reduce the rate of negative appendectomy [22].The Alvarado score includes laboratory findings, symptoms such as nausea, pain localization and anorexia in the scoring system.In addition, clinical signs like elevated body temperature and tenderness are represented.Modifications were suggested, however, according to a recently published systematic review, the original Alvarado score outperformed the modified Alvarado score across all three criteria [23].USS is the most commonly used modality confirming the diagnosis of appendicitis after clinical suspicion with a sensitivity and specificity between 71% and 97% [24].The limitations include examiner and patient dependent validity.CT has reduced the negative appendectomy rate to less than 10% (compared to 21% in the pre-CT era) however involves ionizing radiation and relatively high costs [25].Diagnostic laparoscopy is an accurate diagnostic and treatment option when patient history, clinical examination and diagnostic tests are highly suspicious for an acute appendicitis, especially in young, female and otherwise healthy patients.
The current study has several limitations, including a potential selection and recruitment bias as well as statistical uncertainty.Patients with very early and self-limited appendicitis could have been missed as well as some patients discharged were lost to follow up.The subgroup analysis was performed in patients that were brought to surgery alone.The sample size calculation was conducted based on the test variable PSP and the primary outcome appendicitis on histology.The authors did not perform multiple sample size calculations addressing the remaining diagnostic tests.The fact that not all patients received imaging may results in underpowered calculations and comparisons.Furthermore, diagnostic modalities and decision to operate may have varied between centers.Another limitation involves the freedom of the investigators to perform or not imaging studies according to their clinical discretion.However, this study was a "pragmatic trial" allowing the use of imaging modalities only when indicated and not routinely as part of the study protocol.Another potential limitation is the fact that this multicenter study included 7 hospitals over an overall three-and-a-half-year period, with 357 patients recruited with suspicion of appendicitis.One may consider this number being low, however the recruitment starts and end date for each hospital differed significantly, mainly due to logistic, delay in ethics approval, and other delays.However, the authors do not consider this as an important limitation, as during the trial period, the diagnosis and management of acute appendicitis did not change over time.In addition, some data sets were incomplete.
The use of the PSP value in the diagnostic workup for appendicitis and in patients with abdominal pain may provide additional information to the doctors such as when to perform a CT, when to operate and when the complaint is highly suspicious for an enteritis or a gastroenteritis.There is a need for a prospective trial where PSP will be routinely included in the work up of appendicitis and the doctors are provided with the test result immediately.Furthermore, PSP should become a laboratory test for daily routine and as such available to the doctor shortly after ordering.

Conclusion
Higher PSP levels are associated with a lower likelihood of having acute appendicitis.With a cut off of 40 ng/ml (when <40/ positive), PSP had the highest accuracy in predicting appendicitis on histology when compared to the Alvarado score, CRP, USS and CT.
list their clinical 6 Volume 3; Issue 02 J Surg, an open access journal ISSN: 2575-9760

Figure 2 :
Figure 2: Laboratory values in patients with and without appendicitis upon discharge.

Figure 3 :
Figure 3: ROC Curve analysis for laboratory values and the Alvarado score for appendicitis.

Citation:
Raptis DA, Dilmurodjon E, Tschuor C, Limani P, Neff T, et al. (2019) Diagnostic Value of Pancreatic Stone Protein in comparison to White Cell Count and C-Reactive Protein in the Diagnosis of Acute Appendicitis -A Prospective Multicenter Diagnostic Accuracy Trial.J Surg 3: 1201.DOI: 10.29011/2575-9760

Figure 5 :
Figure 5: Integration of PSP in the Alvarado score for appendicitis.

Figure 6 :
Figure 6: The value of the different tests in predicting appendicitis on histology.

Citation:
Raptis DA, Dilmurodjon E, Tschuor C, Limani P, Neff T, et al. (2019) Diagnostic Value of Pancreatic Stone Protein in comparison to White Cell Count and C-Reactive Protein in the Diagnosis of Acute Appendicitis -A Prospective Multicenter Diagnostic Accuracy Trial.J Surg 3: 1201.DOI: 10.29011/2575-9760

Table 1
lists all participating centers.

Table 1 :
Baseline demographic and clinical characteristics of participants.Raptis DA, Dilmurodjon E, Tschuor C, Limani P, Neff T, et al. (2019) Diagnostic Value of Pancreatic Stone Protein in comparison to White Cell Count and C-Reactive Protein in the Diagnosis of Acute Appendicitis -A Prospective Multicenter Diagnostic Accuracy Trial.J Surg 3: 1201.DOI: 10.29011/2575-9760.001201 Citation: 4 Volume 3; Issue 02 J Surg, an open access journal ISSN: 2575-9760

Table 2 :
The Alvarado score and likelihood of appendicitis categories.

Table 3 :
and this observation was not available to the managing doctors.Laboratory values.

Table S1 :
Diagnosis upon discharge directly from the emergency room.Raptis DA, Dilmurodjon E, Tschuor C, Limani P, Neff T, et al. (2019) Diagnostic Value of Pancreatic Stone Protein in comparison to White Cell Count and C-Reactive Protein in the Diagnosis of Acute Appendicitis -A Prospective Multicenter Diagnostic Accuracy Trial.J Surg 3: 1201.DOI: 10.29011/2575-9760.001201 Citation:

Table S2 :
illustrates the patient flow.Supplementary TableS4indicates the different types of diagnoses of patients upon discharge from the hospital.Postoperative morbidity as graded by the Clavien-Dindo classification and the quantified by the Comprehensive Complication Index ® (CCI ® ) is reported in Supplementary TableS5.Operation characteristics.

Table S4 :
Diagnosis upon discharge from the emergency room or hospital ward.

Table 4 :
Raptis DA, Dilmurodjon E, Tschuor C, Limani P, Neff T, et al. (2019)Diagnostic Value of Pancreatic Stone Protein in comparison to White Cell Count and C-Reactive Protein in the Diagnosis of Acute Appendicitis -A Prospective Multicenter Diagnostic Accuracy Trial.J Surg 3: 1201.DOI: 10.29011/2575-9760.001201Use and characteristics of imaging. Citation:

Table 5 :
Diagnostic accuracy analysis of test cut-offs for appendicitis.

Table 6 :
Predictors of appendicitis on histology.