|Year : 2022 | Volume
| Issue : 2 | Page : 96-101
Assessment of the utility of a screening tool for COVID-19 diagnosis in an accident and emergency department in Lagos, Nigeria: A pilot study
Erereoghor Otrofanowei1, Iorhen Ephraim Akase1, Bolaji Oluwarotimi Olopade2, Patricia E Akintan3, Uyiekpen E Ima-Edomwonyi2, Yeside Olubunmi Akinbolagbe3, Osigwe Paul Agabi1, Danladi Abraham Nmadu2, Gbemileke O Akinbode4, Adefolarin Opawoye2, C Aramide Olasope2, Adewale Ogundare2, B Abiola Bolarinwa5, Oluwakemi Elizabeth Awojumobi-Otokiti5, Precious J Enajeroh2, Moses Karami2, Christopher Imokhuede Esezobor3, Gbenga Olorunfemi6, Yewande O Oshodi6, Ayotunde Ayodeji Oluwole7, Wasiu Lanre Adeyemo8, Christopher O Bode9
1 Department of Medicine, University of Lagos, Idi-Araba, Lagos, Nigeria
2 Department of Medicine, Lagos University Teaching Hospital, Lagos, Nigeria
3 Department of Pediatrics, College of Medicine, University of Lagos, Idi-Araba, Nigeria
4 Department of Surgery, Lagos University Teaching Hospital, Lagos, Nigeria
5 Department of Hematology and Blood Transfusion, Lagos University Teaching Hospital, Lagos, Nigeria
6 Division of Epidemiology and Biostatistics, University of Witwatersrand, Johannesburg, South Africa
7 Department of Obstetrics and Gynaecology, College of Medicine, University of Lagos, Idi-Araba, Lagos, Nigeria
8 Department of Oral and Maxillofacial Surgery, College of Medicine, University of Lagos, Idi-Araba, Lagos, Nigeria
9 Department of Surgery, College of Medicine, University of Lagos, Idi-Araba, Lagos, Nigeria
|Date of Submission||21-Dec-2021|
|Date of Decision||19-Feb-2022|
|Date of Acceptance||19-Mar-2022|
|Date of Web Publication||23-Apr-2022|
Iorhen Ephraim Akase
Department of Medicine, Infectious Disease Unit, College of Medicine, University of Lagos, Idi.Araba, Lagos
Source of Support: None, Conflict of Interest: None
The use of reverse transcription–polymerase chain reaction (RT-PCR) is the gold standard laboratory test for diagnosing SARS-CoV-2 infection. However, it has the disadvantage of a long turnaround time and cost. The Nigeria Centre for Disease Control (NCDC) formulated a case definition for COVID-19. We sought to determine the utility of a 14-item, point-weighted clinical screening questionnaire adapted from the NCDC case definition in identifying patients more likely to have the disease. This was to aid prompt clinical decision-making. Methods: We retrospectively reviewed the data of 113 non-surgical patients presenting to the Accident and Emergency Department (A and E) of Lagos University Teaching Hospital, Lagos, Nigeria. Patients were stratified based on screening scores into low (0–2), moderate (3–5) and high (6) pre-test categories. Patients with low and high scores ≥6 were admitted to the A and E and the COVID-19 holding ward, respectively, while the moderate group had chest computed tomography scans to aid further decision-making, pending the outcome of their RT-PCR results. The validity of the triage score as compared to the RT-PCR test result was calculated and the kappa score of agreement was utilised to evaluate the concordance between two triage scores. The optimum cut-off score was also obtained based on the maximal Younden's index. Results: The frequencies of low, moderate and high pre-test scores were 34 (30%), 43 (38.1%) and 36 (31.9%), respectively. Overall, 38.1% (43/113) were RT-PCR positive. RT-PCR was positive in 26.5% (9/34) with low screening scores, 55.8% (24/43) with moderate scores and 27.8% (10/36) with high scores. The sensitivity and specificity of a high score of 6 were 25% and 92.86%, while the lower score of 3 had sensitivity and specificity of 62.5% and 58.6%, respectively. Conclusion: The screening tool showed a high specificity in its initial design, which suggests that anyone with a low score using this tool has a high probability of testing negative. We recommend a cut-off score of 4 (score A) or 6 (score B) of the current screening tool be used to increase the chances of identifying persons with COVID-19 for RT-PCR testing.
Keywords: Accident and emergency, COVID-19, reverse transcription–polymerase chain reaction, screening tool
|How to cite this article:|
Otrofanowei E, Akase IE, Olopade BO, Akintan PE, Ima-Edomwonyi UE, Akinbolagbe YO, Agabi OP, Nmadu DA, Akinbode GO, Opawoye A, Olasope C A, Ogundare A, Bolarinwa B A, Awojumobi-Otokiti OE, Enajeroh PJ, Karami M, Esezobor CI, Olorunfemi G, Oshodi YO, Oluwole AA, Adeyemo WL, Bode CO. Assessment of the utility of a screening tool for COVID-19 diagnosis in an accident and emergency department in Lagos, Nigeria: A pilot study. Niger Postgrad Med J 2022;29:96-101
|How to cite this URL:|
Otrofanowei E, Akase IE, Olopade BO, Akintan PE, Ima-Edomwonyi UE, Akinbolagbe YO, Agabi OP, Nmadu DA, Akinbode GO, Opawoye A, Olasope C A, Ogundare A, Bolarinwa B A, Awojumobi-Otokiti OE, Enajeroh PJ, Karami M, Esezobor CI, Olorunfemi G, Oshodi YO, Oluwole AA, Adeyemo WL, Bode CO. Assessment of the utility of a screening tool for COVID-19 diagnosis in an accident and emergency department in Lagos, Nigeria: A pilot study. Niger Postgrad Med J [serial online] 2022 [cited 2023 Feb 6];29:96-101. Available from: https://www.npmj.org/text.asp?2022/29/2/96/343743
| Introduction|| |
The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes the coronavirus diseases (labelled COVID-19 by the World Health Organization), is a major pandemic with associated morbidity and mortality. Nigeria has a high infectious disease vulnerability index based on high population density. Moreover, poor implementation of social distancing protocol and inadequate COVID-19 testing in the population are strong factors encouraging the transmission of the disease in the country. The Nigerian Centre for Disease Control (NCDC) updated its National Case Definition for COVID-19 in March 2020 releasing a screening tool to guide health practitioners on who to refer for COVID-19 test. This was necessary to guide rational use of the available test kits for symptomatic patients who were likely to test positive than asymptomatic carriers (even with a positive history of contact to a certified patient). The SARS-CoV-2 polymerase chain reaction (PCR) test, however, has a turnaround time (TAT) of between 24 and 48 h, which poses a challenge for patients presenting in an emergency setting, where clinicians need to decide whether to admit into the accident and emergency (A and E), or into the holding ward for suspected COVID-19 infection. The need for confirmatory virology test with reverse transcription (RT)-PCR leads to delays in the management of these patients who may not have COVID-19 but present with other morbidities that require urgent intervention in the A and E, hence the need for an evidence-based, yet efficient approach to triaging suspected cases.
Due to rising need for increased testing and treatment capacity, the management of Lagos University Teaching Hospital (LUTH) under the Federal Ministry of Health put the operational capacity in place for the screening of suspected cases of COVID and the triaging and management of confirmed cases as per NCDC guidelines., A COVID response team was mobilised, trained and subsequently activated for the above objectives. Given time and resource constraints as stated above, the LUTH COVID-19 response team utilised the NCDC's case definition and created a weighted screening tool that reflected our tertiary care context, especially in the face of limited COVID-19 test and extraction kits in the country [Appendix 1]. The primary intention of this tool was to clinically evaluate all patients presenting to A and E to discriminate them into high pre-test probability and low pre-test probability for COVID-19, and thereby avoid unnecessary admissions into the suspected COVID-19 ward, where their care could be compromised while awaiting the availability of the PCR tests, which may take between 48 and 72 h. The aim of this study was, therefore, to evaluate the diagnostic utility of the screening questionnaire in triaging patients in the A and E to identify patients with COVID-19, especially where the presentation could have been due to an alternative diagnosis.
| Methods|| |
This was a retrospective cross-sectional study conducted at LUTH adult Accident and Emergency Department (A and E). The hospital is a leading tertiary centre in Nigeria which serves Lagos and surrounding states, and receives referrals from other parts of the country. The A and E department has a triage team trained to rapidly sort patients. The triage team is made up of medical officers and resident doctors and headed by two consultants. Ethical approval to conduct this research was sought and obtained from the Health Research and Ethics Committee of LUTH with approval number LUTHHREC/EREV/0520/40.
All patients who had the COVID-19 screening tool administered after a suspicion of COVID-19 at the LUTH A and E triage for the period under review were included in the study.
All patients presenting with non-surgically related illnesses seen by the triage team during the period under review (1 August 2020–31 September 2020) were evaluated for possible COVID-19 infection using the structured screening tool [Appendix 1]. The questionnaire contained a checklist of 14 items, which were given weighted points. The total points accrued after the clinical evaluation were utilised to make decisions at A and E. Patients with scores of 0–2 were labelled low pre-test category and admitted into the A and E for further management, while those with scores between 3 and 5 were labelled moderate pre-test category and sent for chest CT scan, and those with scores ≥6 labelled as high pre-test category. Patients with high pre-test category and moderate pre-test category patients whose computed tomography (CT) scans were suggestive of COVID-19 were reviewed by the Infectious Disease Unit, and eventually admitted into the holding area of the COVID-19 ward for PCR sampling and treatment in line with protocol. Details of age, gender, presenting complaints, history of contact with COVID-positive patient, alternate medical conditions to explain clinical features and final score allotted were extracted from the case records. These were matched against the result of the RT-PCR test to assess the accuracy of the screening tool (sensitivity and specificity) in detecting COVID-19 infection. Two triage scores were studied. Both scores A and B had 14 variables; score B had weighted scores ranging from +1 to +3, with higher scores assigned to recent onset shortness of breath, easy fatigability, history of recent travel/known contact with an individual with COVID-19 and a score of −3 for the presence of an alternative diagnosis. Score A was a non-weighted scale, with a score of +1 given to all the variables except for the presence of an alternative diagnosis which had a score of −1 [Appendix 1]. For both scores, the absence of the criteria being assessed was awarded a score of 0.
The data was entered into Excel spreadsheet and then imported into StataCorp. 2019. Stata Statistical Software: Release 16. (College Station, TX, USA: StataCorp LLC.). Continuous variables were described as mean and standard deviation while categorical variables were described as frequency and percentages. The prevalence (and 95% confidence interval [CI]) of COVID-19 based on PCR test results was calculated. Student's t-test and Pearson's Chi-square test were, respectively, utilised to assess the association between age, gender and COVID-19 status. The association between triage classification score (0–2 [low], 3–5 [moderate] and ≥6 [high risk]) and COVID-19-positive results was assessed using the Pearson's Chi-square and McNemar test. Validity test (sensitivity, specificity, negative predictive value and positive predictive value) of the triage score A and score B was assessed at cut-off of 6 (high risk) and 3 (moderate to high risk), respectively. Series of threshold of a cut-off point of score A was conducted using receiver operating characteristic (ROC) curves. The optimum cut-off score was then calculated using the maximal Younden's index. Similarly, the optimum cut-off for Score B was also calculated. Concordance between scores A and B was assessed using the Cohen's kappa score of agreement. The accuracy of predicting COVID-19 using scores A and B was also compared by comparing the area under the ROC of the two triage scores. P < 0.05 was considered statistically significant, and two-tailed test of hypothesis was assumed.
| Results|| |
The prevalence of COVID-19 amongst the study population was 40.6% (95% CI: 31.4%–50.5%), n = 41/101. Three of the participants with COVID test did not have triage score and were excluded from further analysis. After the exclusion, the prevalence of positive COVID result was 40.8% (95% CI: 31.4%–50.9%).
More than half of the study participants were female (58/95; 61.05%) and the average age of the participants was 37.47 ± 14.96 years and about 60% of the participants were younger than 40 years. From [Table 1], there was no statistically significant relationship between gender and age and COVID-19 PCR status. [Table 2] shows the prevalence of Covid -19 in the study population. The predictive prevalence of COVID-19 based on Triage Score B (≥6) was 31.6% (95% CI: 23.1% - 41.6%), n = 31/98, which was lower than the predictive prevalence of COVID-19 based on Triage Score A (≥4).
|Table 1: Comparison of the socio-demographic characteristics amongst participants with positive and negative COVID-19 polymerase chain reaction test|
Click here to view
|Table 2: Comparison of true positive and true negative of triage score A and score B in predicting COVID positivity|
Click here to view
Performance of triage score A
When the differential-weighted score tool was used (score A), the optimum cut-off triage score for diagnosing positive COVID-19 was 4 with sensitivity and specificity of 52.5% and 68.97%, respectively. However, as shown from [Table 3], the accuracy of the test is poor, with the area under the ROC curve of 0.60 and correctly classifying only 62.67% of cases. When the performance was stratified by gender, the optimum cut-off for males was 4 while the optimum cut-off for females was 5. The area under the curve (AUC) of ROC for male participants was slightly higher than for females (0.64 vs. 0.59).
|Table 3: The utility of COVID triage score A in diagnosing/predicting COVID as compared to polymerase chain reaction as gold standard|
Click here to view
Of all the various clinical scenarios, the best performance of the triage score A will be amongst older males (male and ≥40 years) with ROC of 79.9% at optimum cut-off score of 3. Generally, the triage tool A appears to be more useful as a diagnostic tool than a screening tool as the specificity (true negative rate) was generally higher than the sensitivity (true-positive rate) in all scenarios. Based on the priori classification of the triage tool (0–2 [low], 3–5 [moderate] and ≥6 [high risk]), the sensitivity and specificity of triage score A at cut-off of 6 (high risk) were 25% and 92.86%, respectively [Supplementary Table 1], while the sensitivity and specificity of the triage score A at cut-off of 3 (moderate-to-high-risk classification) were 62.5% and 58.62%, respectively [Supplementary Table 2].
Performance of triage score B
From [Table 4], the optimum cut-off triage score B (non-differential-weighted score) for diagnosing positive COVID-19 was 6 with sensitivity and specificity of 40.0% and 74.14%, respectively. However, the accuracy of the test is poor, with the area under the ROC curve of 0.52 and correctly classifying only 60.20% of cases. When the performance was stratified by gender, the optimum cut-off score for males was 8 while the optimum cut-off score for females was 6. The AUC of ROC for male participants appears higher than for females (0.58 vs. 0.48). Of all the various clinical scenarios, the best performance of the triage score will be amongst older males (male and ≥40 years) with ROC of 66.7% at optimum cut-off score of 8. Generally, the triage tool appears to be more useful as a diagnostic tool than a screening tool as the specificity (true negative rate) was generally higher than the sensitivity (true-positive rate).
|Table 4: The utility of COVID triage score B in diagnosing/predicting COVID as compared to polymerase chain reaction as gold standard|
Click here to view
Comparison of the performance of triage score A and score B
As shown in [Table 5], the ROC for score A was higher than the ROC for score B (0.60 vs. 0.52, P = 0.0047). The kappa score of agreement between the predictive values of score A and score B for diagnosing positive COVID test was fairly good (0.78, P < 0.0001).
|Table 5: Comparison of the overall performance of triage score A and score B in predicting COVID positivity|
Click here to view
| Discussion|| |
This study aimed to evaluate the utility of NCDC triage score as a useful algorithm in the diagnosis and management of COVID-19 patients in our environment. The justification for a clinical screening tool in our centre lay in the fact that our ward for keeping patients with suspected COVID-19 (i.e., individuals who fulfilled case definition for COVID-19 but who could still turn out to be negative) was not sufficient to accommodate the high number of possible/suspected cases that presented to our A and E. Our report has generated hypothesis and basis for larger study to guide decision.
The study showed that males had a higher test positivity rate (51.4% vs. 37.9%), a similar finding reported in some other studies within and outside the country., A meta-analysis revealed that male sex is associated with a significantly increased risk of mortality within s COVID-19 patient despite no differences in the risk of infection, which may be attributed to both socio-economic factors and fundamental differences in the immune responses between males and females.
The above demographic characteristics indicate that despite the dangers of the pandemic, the need to go out and earn a daily living outweighed the dangers posed by the virus.
The specificity of 74.14 (score B) and 68.97 (score A), as well as AUC ROC of 0.5183 (95% CI: 0.3962–0.6405) and 0.5985 (95% CI: 0.4804–0.7166) for scores B and A, respectively, as demonstrated in our study, will seem to suggest a positive role for such clinical algorithms when their primary role is to prevent unwarranted admissions into the infectious disease ward. Management of alternative diagnoses will not only have been compromised, but the previously uninfected (but clearly vulnerable) patients will be at a higher risk of getting infected with COVID-19. A similar study conducted in Brazil found that the use of two or more symptoms with or without anosmia or ageusia in a patient without known contact or one or more symptoms with or without anosmia or ageusia in a patient with known contact was 80.4% accurate in clinical diagnosis of COVID-19, and yielded a higher pre-test probability and accuracy than the RT-PCR for SARS-COVID-19. A model that utilised machine learning algorithm for the diagnosis of COVID-19 had an area under the ROC of 0.91 (95% CI: 0.87–0.96) and achieved a sensitivity of 0.93 (95% CI: 0.85–0.98) and specificity of 0.64 (95% CI: 0.58–0.69).
This tool was primarily intended to be highly discriminatory and specific, i.e., identify patients presenting in the A and E with a low pre-test probability of COVID-19 so that they could receive care in the A and E, and not be transferred to the COVID-19 ward. In this regard, a low sensitivity as recorded with this tool using a score of 6 will probably make it pertinent for such patients to still be sampled for SARS-CoV-2 RT-PCR while receiving the needed care within the A and E and applying all the standard precautions for infection prevention and control.
Clinical algorithms for the diagnosis of COVID-19 generally suffer due to the non-specific symptoms and the varied clinical presentations patients may present with, making the accurate clinical diagnosis of COVID-19 unreliable. However, if clinical algorithms such as ours are used primarily to determine pre-test probability and therefore guide admission patterns in resource-limited but over-burdened multidisciplinary settings like ours, it could potentially shorten the time to access the appropriate specialist care, especially in an emergency setting. Additionally, using a clinical scoring tool to determine who should undergo chest CT scan for further decision-making is a very useful way of both reducing patient expenditure and limiting exposure to radiation amongst such patients.
The limitation of this study was that it was a retrospective study and sample size was not calculated. Thus, the power of the utilised sample size may not be adequate.
| Conclusion|| |
The clinical algorithm as developed and utilised in our hospital showed some specificity in its initial design. It helped to identify and limit the number of patients that will have to be sent for chest imaging, thereby making efficient use or limited resources and reducing patients' exposure to radiations.
A screening score of 4 (score A) or 6 (score B) of the current screening tool will increase the chances of identifying persons with COVID-19 for RT-PCR testing. It is also recommended that the negative score of − 3 which was to capture alternative diagnosis should be expunged due to the prevailing community spread of the disease. A larger multicentre study can be conducted to validate our findings.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Moore M, Gelfeld B, Okunogbe A, Paul C. Identifying future disease hot spots: Infectious disease vulnerability index. Rand Health Q 2017;6:5.
Nigeria Center for Disease Control (NCDC). COVID-19 Clinical Case Management. Available from: https://www.covid19.ncdc.gov.ng
. [Last accessed on 2020 May 09].
Otuonye NM, Olumade TJ, Ojetunde MM, Holdbrooke SA, Ayoola JB, Nyam IY, et al.
Clinical and demographic characteristics of COVID-19 patients in Lagos, Nigeria: A descriptive study. J Natl Med Assoc 2021;113:301-6.
Jin JM, Bai P, He W, Wu F, Liu XF, Han DM, et al.
Gender differences in patients with COVID-19: Focus on severity and mortality. Front Public Health 2020;8:152.
Peckham H, de Gruijter NM, Raine C, Radziszewska A, Ciurtin C, Wedderburn LR, et al.
Male sex identified by global COVID-19 meta-analysis as a risk factor for death and ITU admission. Nat Commun 2020;11:6317.
Andam K, Edeh H, Oboh V, Pauw K, Thurlow J. Impacts of COVID-19 on food systems and poverty in Nigeria. Adv Food Secur Sustain 2020;5:145-73.
Cadegiani FA, Zimerman RA, de Souza BC, McCoy J, e Costa RA, Wambier CG, et al
. The AndroCoV clinical scoring for COVID-19 diagnosis: A prompt, feasible, costless, and highly sensitive diagnostic tool for COVID-19 based on a 1757-patient cohort. Cureus 2021;13:e12565. doi: 10.7759/cureus.12565.
Goodman-Meza D, Rudas A, Chiang JN, Adamson PC, Ebinger J, Sun N, et al
. A machine learning algorithm to increase COVID-19 inpatient diagnostic capacity. PLoS One 2020;15:e0239474.
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]