Diagnostic tests’ decision-making rules based upon analysis of ROC-curves
Keywords:
ROC-curve, the diagnostic test, the mathematical model, the sensitivity of the test, the specificity of the test
Abstract
In this paper we propose the model which substantiates diagnostics decision making based on the analysis of Receiver Operating Characteristic curves (ROC-curves) and predicts optimal values of diagnostic indicators of biomedical information. To assess the quality of the test result prediction the standard criteria of the sensitivity and specificity of the model were used. Values of these criteria were calculated for the cases when the sensitivity of the test was greater than specificity by several times, when the number of correct diagnoses was maximal, when the sensitivity of the test was equal to its specificity and the sensitivity of the test was several times greater than the specificity of the test. To assess the significance of the factor characteristics and to compare the prognostic characteristics of models we used mathematical modeling and plotting the ROC-curves. The optimal value of the diagnostic indicator was found to be achieved when the sensitivity of the test is equal to its specificity. The model was adapted to solve the case when the sensitivity of the test is greater than specificity of the test.Downloads
Download data is not yet available.
References
1. Рак в Україні, 2011–2012. Захворюваність, смертність, показники діяльності онкологічної служби: Бюл. Нац. канцерреєстру України. (2013). Київ, 2013. 14 (28). / Rak v Ukrai’ni, 2011–2012. Zahvorjuvanist’, smertnist’, pokaznyky dijal’nosti onkologichnoi’ sluzhby. Bjul. Nac. kancerrejestru Ukrai’ny [Text]. – Kyi’v, 2013. – № 14 (28).
2. Plsek, P. E. The challenge of complexity in health care / P. E. Plsek, T. Greenhalgh // BMJ. - 2001. - V. 323 (7313). - P. 625-628.
3. Симанков В. С. Системный анализ и современные информационные технологии в медицинских сиcтемах поддержки принятия решений / В. С. Симанков, А. А. Халафян . - Москва: Бином Пресс, 2009. - 362 с. /Simankov V. S. Sistemnyj analiz i sovremennye informacionnye tehnologii v medicinskih sictemah podderzhki prinjatija reshenij / V. S. Simankov, A. A. Halafjan . - Moskva: Binom Press, 2009. - 362 s./
4. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review / A. X. Garg, N. K. Adhikari, H. McDonald [et al.] // JAMA. - 2005. - V. 293 (10). - P. 1223-38.
5. Wasyluk H. Support of diagnosis of liver disorders based on a causal Bayesian network model. Medical Science Monitor / H. Wasyluk, A. Onisko, M. J. Druzdzel // Medical Science Monitor. - 2001. - V. 7 (1). - P. 327-332.
6. Leape L. L. Error in medicine / L. L. Leape // JAMA. - 1994. - V. 272. - P. 1851-1857.
7. Carayon P. Patient Safety: The Role of Human Factors and Systems Engineering / P. Carayon, K. E. Wood // Stud. Health Technol. Inform. - 2010. - V. 153. - P. 23-46.
8. Vincent C. Framework for analyzing risk and safety in clinical medicine / C. Vincent, S. Taylor-Adams, V. Stanhope // BMJ. - 1998. - V. 316 (7138). - P. 1154-1157.
9. Fawcett T. An introduction to ROC analysis / T. Fawcett // Institute for the Study of Learning and Expertise, Pattern Recognition Letters. - 2006. - V. 27. - P. 861-874.
10. Петри А. Наглядная статистика в медицине / А. Петри, К. Сэбин; [пер. с англ. В. П. Леонова]. - Москва: ГЭОТАРМЕД, 2003. - 144c. /Petri A. Nagljadnaja statistika v medicine / A. Petri, K. Sjebin; [per. s angl. V. P. Leonova]. - Moskva: GJeOTARMED, 2003. - 144c./
11. Файнзильберг Л.С. Гарантированная оценка эффективности диагностических тестов на основе усиленного ROC-анализа / Л. С. Файнзильберг, Т. Н. Жук // Управляющие системы и машины. - 2009. - Т. 5. - С. 3-13. /Fajnzil'berg L.S. Garantirovannaja ocenka jeffektivnosti diagnosticheskih testov na osnove usilennogo ROC-analiza / L. S. Fajnzil'berg, T. N. Zhuk // Upravljajushhie sistemy i mashiny. - 2009. - T. 5. - S. 3-13./
12. Fawcett T. ROC Graphs: Notes and Practical Considerations for Researches / T. Fawcett. - Kluwer Acad. Publ., 2004. - 56 p.
13. Власов В. В. Эффективность диагностических исследований / В. В. Власов. - Москва: Медицина, 1988. - 245 c. /Vlasov V. V. Jeffektivnost' diagnosticheskih issledovanij / V. V. Vlasov. - Moskva: Medicina, 1988. - 245 c./
2. Plsek, P. E. The challenge of complexity in health care / P. E. Plsek, T. Greenhalgh // BMJ. - 2001. - V. 323 (7313). - P. 625-628.
3. Симанков В. С. Системный анализ и современные информационные технологии в медицинских сиcтемах поддержки принятия решений / В. С. Симанков, А. А. Халафян . - Москва: Бином Пресс, 2009. - 362 с. /Simankov V. S. Sistemnyj analiz i sovremennye informacionnye tehnologii v medicinskih sictemah podderzhki prinjatija reshenij / V. S. Simankov, A. A. Halafjan . - Moskva: Binom Press, 2009. - 362 s./
4. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review / A. X. Garg, N. K. Adhikari, H. McDonald [et al.] // JAMA. - 2005. - V. 293 (10). - P. 1223-38.
5. Wasyluk H. Support of diagnosis of liver disorders based on a causal Bayesian network model. Medical Science Monitor / H. Wasyluk, A. Onisko, M. J. Druzdzel // Medical Science Monitor. - 2001. - V. 7 (1). - P. 327-332.
6. Leape L. L. Error in medicine / L. L. Leape // JAMA. - 1994. - V. 272. - P. 1851-1857.
7. Carayon P. Patient Safety: The Role of Human Factors and Systems Engineering / P. Carayon, K. E. Wood // Stud. Health Technol. Inform. - 2010. - V. 153. - P. 23-46.
8. Vincent C. Framework for analyzing risk and safety in clinical medicine / C. Vincent, S. Taylor-Adams, V. Stanhope // BMJ. - 1998. - V. 316 (7138). - P. 1154-1157.
9. Fawcett T. An introduction to ROC analysis / T. Fawcett // Institute for the Study of Learning and Expertise, Pattern Recognition Letters. - 2006. - V. 27. - P. 861-874.
10. Петри А. Наглядная статистика в медицине / А. Петри, К. Сэбин; [пер. с англ. В. П. Леонова]. - Москва: ГЭОТАРМЕД, 2003. - 144c. /Petri A. Nagljadnaja statistika v medicine / A. Petri, K. Sjebin; [per. s angl. V. P. Leonova]. - Moskva: GJeOTARMED, 2003. - 144c./
11. Файнзильберг Л.С. Гарантированная оценка эффективности диагностических тестов на основе усиленного ROC-анализа / Л. С. Файнзильберг, Т. Н. Жук // Управляющие системы и машины. - 2009. - Т. 5. - С. 3-13. /Fajnzil'berg L.S. Garantirovannaja ocenka jeffektivnosti diagnosticheskih testov na osnove usilennogo ROC-analiza / L. S. Fajnzil'berg, T. N. Zhuk // Upravljajushhie sistemy i mashiny. - 2009. - T. 5. - S. 3-13./
12. Fawcett T. ROC Graphs: Notes and Practical Considerations for Researches / T. Fawcett. - Kluwer Acad. Publ., 2004. - 56 p.
13. Власов В. В. Эффективность диагностических исследований / В. В. Власов. - Москва: Медицина, 1988. - 245 c. /Vlasov V. V. Jeffektivnost' diagnosticheskih issledovanij / V. V. Vlasov. - Moskva: Medicina, 1988. - 245 c./
Cited
How to Cite
Батюк, Л. В. (1). Diagnostic tests’ decision-making rules based upon analysis of ROC-curves. Biophysical Bulletin, 1(33), 68-72. Retrieved from https://periodicals.karazin.ua/biophysvisnyk/article/view/4377
Section
Medical physics
Copyright (c) 2015 Батюк Л. В.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
