Leonardo Maia Leony , Larissa Carvalho Medrado Vasconcelos , Ricardo Sampaio Hein da Silva , Aquiles Assunção Camelier , Antônio Carlos Bandeira , Deivide Luis Souza Costa , Isadora Cristina de Siqueira , Fred Luciano Neves Santos
{"title":"评估用于诊断 SARS-CoV-2 的商业血清学测试的性能","authors":"Leonardo Maia Leony , Larissa Carvalho Medrado Vasconcelos , Ricardo Sampaio Hein da Silva , Aquiles Assunção Camelier , Antônio Carlos Bandeira , Deivide Luis Souza Costa , Isadora Cristina de Siqueira , Fred Luciano Neves Santos","doi":"10.1016/j.ijregi.2024.100383","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><p>The emergence of SARS-CoV-2 has triggered a global pandemic with profound implications for public health. Rapid changes in the pandemic landscape and limitations in <em>in vitro</em> diagnostics led to the introduction of numerous diagnostic devices with variable performance. In this study, we evaluated three commercial serological assays in Brazil for detecting anti-SARS-CoV-2 antibodies.</p></div><div><h3>Methods</h3><p>We collected 90 serum samples from SARS-CoV-2-negative blood donors and 352 from SARS-CoV-2-positive, unvaccinated patients, categorized by symptom onset. Subsequently, we assessed the diagnostic performance of three commercial enzyme immunoassays: GOLD ELISA (enzyme-linked immunosorbent assay) COVID-19 Ig (immunoglobulin) G + IgM, Anti-SARS-CoV-2 NCP IgM ELISA, and Anti-SARS-CoV-2 NCP IgG ELISA.</p></div><div><h3>Results</h3><p>Our findings revealed that the GOLD ELISA COVID-19 IgG + IgM exhibited the highest sensitivity (57.7%) and diagnostic odds ratio, surpassing the manufacturer's reported sensitivity in most analyzed time frames while maintaining exceptional specificity (98.9%). Conversely, the Anti-SARS-CoV-2 NCP IgG ELISA demonstrated lower sensitivity but aligned with independent evaluations, boasting a specificity of 100%. However, the Anti-SARS-CoV-2 NCP IgM ELISA exhibited lower sensitivity than claimed, particularly in samples collected shortly after positive reverse transcription polymerase chain reaction results. Performance improved 15-21 days after symptom onset and beyond 22 days, but in the first week, both Anti-SARS-CoV-2 NCP IgM ELISA and Anti-SARS-CoV-2 NCP IgG ELISA struggled to differentiate positive and negative samples.</p></div><div><h3>Conclusions</h3><p>Our study emphasizes the need for standardized validation protocols to address discrepancies between manufacturer-claimed and actual performance. These insights provide essential information for health care practitioners and policymakers regarding the diagnostic capabilities of these assays in various clinical scenarios.</p></div>","PeriodicalId":73335,"journal":{"name":"IJID regions","volume":null,"pages":null},"PeriodicalIF":1.5000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772707624000547/pdfft?md5=72f324bf4f26887807919956171f78ae&pid=1-s2.0-S2772707624000547-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Assessing the performance of commercial serological tests for SARS-CoV-2 diagnosis\",\"authors\":\"Leonardo Maia Leony , Larissa Carvalho Medrado Vasconcelos , Ricardo Sampaio Hein da Silva , Aquiles Assunção Camelier , Antônio Carlos Bandeira , Deivide Luis Souza Costa , Isadora Cristina de Siqueira , Fred Luciano Neves Santos\",\"doi\":\"10.1016/j.ijregi.2024.100383\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objectives</h3><p>The emergence of SARS-CoV-2 has triggered a global pandemic with profound implications for public health. Rapid changes in the pandemic landscape and limitations in <em>in vitro</em> diagnostics led to the introduction of numerous diagnostic devices with variable performance. In this study, we evaluated three commercial serological assays in Brazil for detecting anti-SARS-CoV-2 antibodies.</p></div><div><h3>Methods</h3><p>We collected 90 serum samples from SARS-CoV-2-negative blood donors and 352 from SARS-CoV-2-positive, unvaccinated patients, categorized by symptom onset. Subsequently, we assessed the diagnostic performance of three commercial enzyme immunoassays: GOLD ELISA (enzyme-linked immunosorbent assay) COVID-19 Ig (immunoglobulin) G + IgM, Anti-SARS-CoV-2 NCP IgM ELISA, and Anti-SARS-CoV-2 NCP IgG ELISA.</p></div><div><h3>Results</h3><p>Our findings revealed that the GOLD ELISA COVID-19 IgG + IgM exhibited the highest sensitivity (57.7%) and diagnostic odds ratio, surpassing the manufacturer's reported sensitivity in most analyzed time frames while maintaining exceptional specificity (98.9%). Conversely, the Anti-SARS-CoV-2 NCP IgG ELISA demonstrated lower sensitivity but aligned with independent evaluations, boasting a specificity of 100%. However, the Anti-SARS-CoV-2 NCP IgM ELISA exhibited lower sensitivity than claimed, particularly in samples collected shortly after positive reverse transcription polymerase chain reaction results. Performance improved 15-21 days after symptom onset and beyond 22 days, but in the first week, both Anti-SARS-CoV-2 NCP IgM ELISA and Anti-SARS-CoV-2 NCP IgG ELISA struggled to differentiate positive and negative samples.</p></div><div><h3>Conclusions</h3><p>Our study emphasizes the need for standardized validation protocols to address discrepancies between manufacturer-claimed and actual performance. These insights provide essential information for health care practitioners and policymakers regarding the diagnostic capabilities of these assays in various clinical scenarios.</p></div>\",\"PeriodicalId\":73335,\"journal\":{\"name\":\"IJID regions\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2772707624000547/pdfft?md5=72f324bf4f26887807919956171f78ae&pid=1-s2.0-S2772707624000547-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IJID regions\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2772707624000547\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"INFECTIOUS DISEASES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IJID regions","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2772707624000547","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"INFECTIOUS DISEASES","Score":null,"Total":0}
Assessing the performance of commercial serological tests for SARS-CoV-2 diagnosis
Objectives
The emergence of SARS-CoV-2 has triggered a global pandemic with profound implications for public health. Rapid changes in the pandemic landscape and limitations in in vitro diagnostics led to the introduction of numerous diagnostic devices with variable performance. In this study, we evaluated three commercial serological assays in Brazil for detecting anti-SARS-CoV-2 antibodies.
Methods
We collected 90 serum samples from SARS-CoV-2-negative blood donors and 352 from SARS-CoV-2-positive, unvaccinated patients, categorized by symptom onset. Subsequently, we assessed the diagnostic performance of three commercial enzyme immunoassays: GOLD ELISA (enzyme-linked immunosorbent assay) COVID-19 Ig (immunoglobulin) G + IgM, Anti-SARS-CoV-2 NCP IgM ELISA, and Anti-SARS-CoV-2 NCP IgG ELISA.
Results
Our findings revealed that the GOLD ELISA COVID-19 IgG + IgM exhibited the highest sensitivity (57.7%) and diagnostic odds ratio, surpassing the manufacturer's reported sensitivity in most analyzed time frames while maintaining exceptional specificity (98.9%). Conversely, the Anti-SARS-CoV-2 NCP IgG ELISA demonstrated lower sensitivity but aligned with independent evaluations, boasting a specificity of 100%. However, the Anti-SARS-CoV-2 NCP IgM ELISA exhibited lower sensitivity than claimed, particularly in samples collected shortly after positive reverse transcription polymerase chain reaction results. Performance improved 15-21 days after symptom onset and beyond 22 days, but in the first week, both Anti-SARS-CoV-2 NCP IgM ELISA and Anti-SARS-CoV-2 NCP IgG ELISA struggled to differentiate positive and negative samples.
Conclusions
Our study emphasizes the need for standardized validation protocols to address discrepancies between manufacturer-claimed and actual performance. These insights provide essential information for health care practitioners and policymakers regarding the diagnostic capabilities of these assays in various clinical scenarios.