Radiotherapy reliability analysis based on PSA method

Radiotherapy reliability analysis based on PSA method 1 2 3 first-author 1 2 3 1 2 3 1 2 3 corresp Corresponding author,liqin.hu@fds.org.cn Corresponding author,liqin.hu@fds.org.cn liqin.hu@fds.org.cn Key Laboratory of Neutronics and Radiation Safety, Institute of Nuclear Energy Safety Technology, Chinese Academy of Sciences, Hefei230031, China Key Laboratory of Neutronics and Radiation Safety, Institute of Nuclear Energy Safety Technology, Chinese Academy of Sciences, Hefei230031, China Engineering Technology Research Center of Accurate Radiotherapy of Anhui Province, Hefei230031, China Engineering Technology Research Center of Accurate Radiotherapy of Anhui Province, Hefei230031, China Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions, SuZhou215006, China Collaborative Innovation Center of Radiation Medicine of Jiangsu Higher Education Institutions, SuZhou215006, China The reliability of radiotherapy was evaluated and effective approaches were obtained in order to improve radiotherapy quality by using the Probabilistic Safety Assessment (PSA) method. This study investigated the feasibility of the PSA method being applied to radiotherapy through Image-guided Radiotherapy (IGRT) and chest tumor irradiation. A fault tree has been constructed after analyzing causal relationship of the events. After calculating RiskA, a total inaccuracy radiotherapy probability and the importance of all base events were obtained. The probability of inaccurate radiotherapy was 2.87%. Under the condition that the target delineation was perfectly right, the accuracy of radiotherapy significantly improved. With the calculation without Cone-beam Computed Tomography (CBCT) being corrected before irradiation, the accuracy significantly decreased. The most important events were connected with the human factor. Improving human technical level could enhance radiotherapy quality control efficiently. Probability safety analysis Accurate radiotherapy Reliability Quality control RiskA I. INTRODUCTION 1 Accurate radiotherapy focuses on more reliablility and safety. The ideal accuracy means an accurate planning target volume, which also requires planning actual dose delivery accurately and dose distribution accurately [ 1 1 ]. People have made many efforts to improve the reliability of radiotherapy, but in clinical trails some cases of irradiation have still not been accurate because of unskillful staffs or machinery reasons. What is accurate radiotherapy? There is no quantization definition, just describing words. Accurate analysis must rely on a reasonable definition of accurate. The standards of accuracy depend on the location of the tumor. However, the same location of the tumor has the same standard of accuracy. In addition, an effective method which could analyze the whole radiotherapy course was needed. This method should be used when analyzing the complex dynamic system of interaction between human and machinery factors. The Probabilistic Safety Assessment (PSA) method had been widely applied on nuclear power stations for many years. As an efficient method for complex system analysis, PSA was used in aerospace/aviation and chemical engineering, as well as the nuclear field. PSA method had been applied to radiotherapy by the author to assess the reliability and safety [ 2 2 ]. The advanced nuclear energy research team, FDS (Fusion Design and Study), deeply researched nuclear safety [ 3 3 - 7 7 3-7 ] and has developed a Reliability and Probabilistic Safety Assessment Program named RiskA [ 8 8 - 10 10 8-10 ]. This software was the first probabilistic safety assessment program applied to real-world nuclear power plants in China. This paper analyzes radiotherapy reliability based on the preliminary study of an accurate radiotherapy physics problem and technology [ 11 11 - 15 15 11-15 ]. The total probability of inaccuracy and the importance of all base events were obtained after being calculated in RiskA. In addition, all minimum paths have been arranged. The data for radiotherapy quality control is very important. In a clinical setting, doctors and physicists could improve irradiation accuracy efficiently by putting stress on the most important events. II. METHODS 1 A. Experiment conditions 2 This study is based on chest tumor cases and an Image-guided Radiotherapy (IGRT) system with Cone-beam Computed Tomography (CBCT) corrected on-line. The cases was obtained from a static hospital radiotherapy center. The conditions were: before the mid-tumor, together with chemotherapy; Elekta linear accelerator (precise) with KV magnitude CBCT; Electron portal imaging device (EPID) radiation field validation once a week; in the same simulation machine; with the same treatment planning system and treatment team. B. Definition of the top event 2 In this paper, the top event is inaccurate. According to the clinical experience and various synthesized documents of radiotherapy quality demand, the IGRT inaccuracy of chest tumor is defined as follows. 1. Irradiation targets stray from planned target more than 1 cm 3 Deviation limited size is not determined nowadays though millimeter magnitude and accurate radiotherapy was widely recognized. In ordinary radiotherapy, human movement up to 2 cm–3 cm in the cranio-caudal direction was common [ 16 16 ]. Without respiratory gating technique or other approaches to compromise breathing, a total deviation within 1 cm is acceptable. The dose distribution of Gross Tumor Volume (GTV) and organs at risk (OAR) would be seriously affected if the position were to stray more than 1 cm [ 17 17 ]. Baler et al . [ 18 18 ] noted that the target would loss 6 cm if the set-up errors were more than 1 cm. 2. Deviation of dose delivery to a planned target is more than ± 5% and dose distribution is not satisfied with plan assessment 3 Radiation Units and Measurements (ICRU) Report No. 24 points out: If deviation of dose delivery to a planned target is more than ± 5%, the primary tumor lesion of would be out of control and complications would increase. The target dose to OAR limitation was provided in the Radiation Therapy Oncology Group’s (RTOG) 0225 and 0615 documents. The demand for dose plan assessment and the prescription dose demand were listed in RTOG No. 0418 protocols [ 19 19 ]. C. Building fault tree 2 Firstly analyze the process of all the selected radiotherapy cases. The general stages of IGRT radiotherapy in this study are shown in Fig. 1 Fig. 1 : A fault tree was built retrospectively starting from the analysis of the whole process to a certain procedure or a specific function of the device which is also known as a basic event. At last a fault tree was obtained ( Fig. 2 Fig. 2 ). D. The probabilities of base events 2 Every base event has a probability, even if we pay no attention to it or if it was not recorded at that time. The probabilities of every event were shown in Table 1 Table 1 . 1 1 No. 1 1 Base events 1 1 Definition 1 1 The method of getting probabilities 1 1 Probabilities 1 1 1 1 1 Calculation errors 1 1 TPS Algorithms reasons, dose deviation more than 5% 1 1 Empirical data 1 1 0.0001 1 1 2 1 1 Data transfer errors 1 1 Plan transfer errors 1 1 Hindsight 1 1 0.0001 1 1 3 1 1 Dose setting errors 1 1 The doctors setting a wrong plan dose 1 1 Hindsight 1 1 0.0002 1 1 4 1 1 Plan transcription errors 1 1 Human errors 1 1 Hindsight 1 1 0.0002 1 1 5 1 1 Plan evaluation errors 1 1 Errors in plan evaluation 1 1 Hindsight 1 1 0.0001 1 1 6 1 1 Passively accept the dose deviation 1 1 Adjust failure or tolerate 1 1 Empirical data 1 1 0.0020 1 1 7 1 1 Linear accelerator dose rate errors 1 1 Output inaccurate doses 1 1 Maintenance data 1 1 0.0020 1 1 8 1 1 MLC reasons 1 1 Blade motion fault or leaking rays 1 1 Analog Statistics / Maintenance data 1 1 0.0012 1 1 9 1 1 Misoperation in dose delivery 1 1 Physicist errors in operating equipment 1 1 Empirical data 1 1 0.0015 1 1 10 1 1 According to the wrong patient 1 1 Confuse patients 1 1 Hindsight 1 1 0.0001 1 1 11 1 1 Patient not be corrected by CBCT 1 1 The wrong patient not be found by CBCT imaging 1 1 Hindsight 1 1 0.0015 1 1 12 1 1 Forced to stop 1 1 treatment was forced to suspend because of the machinery or patient special reasons 1 1 Empirical data 1 1 0.0001 1 1 13 1 1 Misdiagnoses about disease 1 1 Benign mass which did not suitable for radiotherapy was irradiated incorrectly 1 1 Empirical data 1 1 0.0001 1 1 14 1 1 Lesions diagnose error 1 1 Location of the tumor diagnostic error more than 1 cm 1 1 Empirical data 1 1 0.0010 1 1 15 1 1 Inaccurate delineation 1 1 PTV sketch errors more than 1 cm 1 1 Analog Statistics / Empirical data 1 1 0.0020 1 1 16 1 1 Simulator guide error 1 1 Parameters inaccuracy 1 1 Maintenance data 1 1 0.0020 1 1 17 1 1 Too thick line 1 1 Surface marker too thick 1 1 Empirical data 1 1 0.0025 1 1 18 1 1 Changes of tumor 1 1 Tumor changed more than 1 cm compared with plan 1 1 Image contrast 1 1 0.0030 1 1 19 1 1 Other reasons 1 1 Other reasons lead to surface marker inaccuracy 1 1 Empirical data 1 1 0.0001 1 1 20 1 1 System errors 1 1 Equipment errors in set-up 1 1 Literature [ 21 21 , 22 22 ] 1 1 0.0025 1 1 21 1 1 physicists errors in set-up 1 1 Positioning offset greater than 1 cm 1 1 Empirical data 1 1 0.0002 1 1 22 1 1 Too obese 1 1 More than standard weight 50% 1 1 Empirical data 1 1 0.0015 1 1 23 1 1 Not corrected by CBCT 1 1 More than 1 cm deviation after CBCT corrected 1 1 Maintenance data/Empirical data 1 1 0.0015 1 1 24 1 1 Patient movement 1 1 Patient movement more than 1 cm during treatment 1 1 Empirical data 1 1 0.0020 1 1 25 1 1 Vacuum phantom fault 1 1 Leak gas between treatment 1 1 Maintenance data 1 1 0.0002 1 1 26 1 1 Treatment table poor stability 1 1 Does not meet the quality assurance requirements 1 1 Maintenance data 1 1 0.0015 1 1 27 1 1 Isocenter errors of linear accelerator 1 1 Does not meet the quality assurance requirements 1 1 Maintenance data 1 1 0.0002 The methods through which the probabilities were obtained all as follows: (1) Empirical data: Most of the probabilities of the base events could be obtained by clinical experience. For example, the frequency of misdiagnosis divided by irradiation times in the past years yield the probability of misdiagnosis. (2) Maintenance data: Some machinery data was obtained from examination and the repair record. The probability was the frequency of fault. (3) Hindsight: Some mistakes were not realized at that time, so analysis afterwards was the only method. (4) Analog Statistics: The simulation statistics method means there was a multi-user outline for the same tumor. For example ICRU reported that the World Health Organization (WHO) organized 12 clinical experts to sketch the same tumor. The difference of the volumes they sketched out nearly double [ 20 20 ]. (5) Literature: Summarize the result by consulting the related literature and data. E. Calculation using RiskA 2 We constructed a fault tree in RiskA and the configuration was the same as Fig. 1 Fig. 1 . Next, all the basic data was put into the tree leaves (base events) and calculated. The analyzed objects were uncertainties and importance . Importance analysis included: Fussell-vesely importance (cut-set importance); RAW (Risk Achievement Worth) importance; RRW (Risk Reduce Worth) importance. Lastly, the outcome was obtained after clicking calculation and analysis capabilities. The whole process of calculation was very convenient. III. RESULTS 1 A. The probability of top event 2 According to the data in Fig. 1 Fig. 1 and Table 1 Table 1 , the probability of a top event was 2.87%, as shown in Table 2 Table 2 . If the probability of target delineation errors is "0", that means that assuming target delineation was completely true, the probability of a top event would change to 1.18% and the total probability drops significantly. If there is no CBCT correction online, the probability of a top event would change to 5.09%, the cases of inaccuracy significantly increased. 1 1 Calculation conditions 1 1 Probability of a top event (inaccuracy) 1 1 Fault tree as shown in Fig. 1 and base events as listed in Table 1. 1 1 2.87 1 1 Assumed target delineation was completely true 1 1 1.18 1 1 Assuming no corrective CBCT online 1 1 5.09 B. The importance of minimal cut sets 2 The minimal cut sets demanstrated the minimal combination of base events which lead to a top event. Every key path and its importance rate are listed in Table 3 Table 3 . 1 1 Constitute of base events 1 1 Importance percentage (%) 1 1 Base event 15 (Inaccurate delineation) 1 1 14.68 1 1 Base event 14 (Lesions diagnose error) 1 1 14.00 1 1 Base event 3 (Lesions diagnose error) 1 1 7.23 1 1 Base event 6 (Passively accept the dose deviation) 1 1 7.03 1 1 Base event 13 (Misdiagnoses about disease) 1 1 0.49 1 1 Base event 24 (Patient movement) 1 1 0.26 C. RRW importance of base events 2 The top event will be reduced correspondingly if one base event is reduced. This effect is called RRW. Contribution rates of main base event reduction has been shown by the importance calculation function of RiskA. Base event reduction means reducing deviation and improving skills in order to reduce the probability of a top event. As shown in Table 4 Table 4 , the most important event was inaccurate delineation, the second was lesion diagnosis error, and the third one was misoperation in dose delivery. The foremost important events were connected with human behavior. In the calculation results the Risk Achievement Worth of base events were almost the same, so the RAW data is not listed in the paper. 1 1 Base event 1 1 Contribution ratio (%) 1 1 15. Inaccurate delineation 1 1 11.90 1 1 14. Lesions diagnose error 1 1 11.00 1 1 9. Misoperation in dose delivery 1 1 7.40 1 1 13. Misdiagnoses about disease 1 1 2.04 1 1 3. Dose setting errors 1 1 1.09 1 1 6. Passively accept the dose deviation 1 1 0.44 1 1 27. Isocenter errors of linear accelerator 1 1 0.02 IV. DISCUSSION AND CONCLUSION 1 A. Assessment of accurate radiotherapy 2 Accurate radiotherapy needs expensive equipment and complex operations, so accuracy is of great importance to cancer patients and doctors. The probability 2.87% should be paid high attention on. Total probability obtained found that the PSA method should be applied in the radiotherapy field in order to assess the reliability. B. The important reasons leading to inaccuracy 2 Table 3 Table 3 shows that the most important event was inaccurate delineation and the importance percentage of this minimal cut sets was 14.68%. Assumming target delineation was completely right, the probability of a top event would reduce by half. Table 4 Table 4 shows that improved delineation technical level was the most efficient method to develop radiotherapy accuracy. But on a particular delineation technical level, the quality would be developed if closed to a biological target [ 23 23 ]. In the future, look forward the biological target recognition technology, irradiation accuracy would be improved [ 24 24 ]. To conclude, almost all the important factors are closely related to the human factor. For example, the most important event in fault tree structure was inaccurate delineation and the second was diagnostic error. As reported in the literature, most errors were attributed to human mistake or inattention in radiotherapy [ 25 25 ]. C. The importance of CBCT to positioning accuracy 2 Some literature demonstrated the importance of CBCT to positioning accuracy [ 26 26 , 27 27 ]. As shown in Table 2 Table 2 , if there is no CBCT correction, the probability of inaccuracy increases to 5.69%, nearly doubled. CBCT can correct the majority of deviations by regarding it to human organs before the actual treatment. CBCT may correct positional errors for the target and critical structures immediately prior to or during treatment. Sometimes, it can correct the wrong patient leading to a safe treatment [ 28 28 ]. As shown in Table 1 Table 1 , the probability was only 0.8/1000 based on clinical experience which the deviation error greater than 1 cm after CBCT correction. D. Guidance to clinical radiotherapy and quality assurance 2 The research verified that the PSA method could be used on a broader area and provide quantitative data in engineering quality control. As a credible software in application [ 29 29 ], RiskA should be an assessment platform of radiotherapy reliability. Focus on safety and reliability is the important feature of ARTS [ 30 30 , 31 31 ]. The quality control function could be improved by integrating quantitative data in this paper. Hospital and administration management should use this method on a different level, using different combinations to analyze the reliability of the radiotherapy and to assess the quality of accuracy radiotherapy. It is emphasized that based on the result calculated by RiskA, weak links could be found and increased radiotherapy quality could be developed by improving weak links. For example, people develop dose reliability by improving the dose calculation method [ 32 32 ]. Of course by analyzing the reliability of the human factor, methods to improve operational reliability could be found. By verifying the reliability of multiple radiotherapy units, the whole radiotherapy reliability level could be assessed. This data could then be combined with clinical opinions, so that the expectative radiotherapy standard pattern used to guide radiotherapy could be set. In conclusion, analysis of radiotherapy reliability based on the PSA method is of great significance to formulate objective standards and quality assurance. References Round C E , Williams M V , Mee T , et al . Clin Oncol , 2013 , 25 : 522 - 530 . Clin Oncol Li W Y , Cao R F , Pei X , et al . T Am Nucl Soc , 2013 , 108 : 307 - 308 . T Am Nucl Soc Wu Y C . Fusion Eng Des , 2009 , 84 : 1897 - 1992 . Fusion Eng Des Wu Y C . J Nucl Mater , 2007 , 367–370 : 1410 - 1415 . J Nucl Mater Wu Y C and FDS team . Fusion Eng Des , 2008 , 83 : 1683 - 1689 . Fusion Eng Des Wu Y C and FDS team . Fusion Eng Des , 2007 , 82 : 1893 - 1903 . Fusion Eng Des Wu Y C and FDS team . Nucl Fusion , 2007 , 47 : 1533 - 1539 . Nucl Fusion Wang F , Li Y , Wang J Q , et al . Fusion Eng Des , 2006 , 81 : 2713 - 2718 . Fusion Eng Des Hu L Q and Wu Y C . Fusion Eng Des , 2006 , 81 : 1403 - 1407 . Fusion Eng Des Hu L , Chen H , Bai Y , et al . Fusion Eng Des , 2010 , 85 : 1577 - 1580 . Fusion Eng Des Cao R F , Wu Y C , Pei X , et al . Chinese Phys C , 2011 , 35 : 313 - 317 . Chinese Phys C Cao R F , Pei X , Zheng H Q , et al . Chinese Med J-peking , 2014 , 127 : 1 - 2 . Chinese Med J-peking Li G , Yang Z , Lin H , et al . Nucl Technol , 2009 , 168 : 815 - 819 . Nucl Technol Chen C , Huang Q , Wu Y , et al . Plasma Sci Technol , 2005 , 7 : 2777 - 2780 . Plasma Sci Technol Li G , Wu Y , Zhang J . Plasma Sci Technol , 2006 , 8 : 234 - 236 . Plasma Sci Technol Seppen woolde Y , Shirato H , Kitamura K , et al . Int J Radiat Oncol Biol Phys , 2002 , 53 : 822 - 834 . Int J Radiat Oncol Biol Phys Schwarz M , Van der Geer J , Van Herk M , et al . Int J Radiat Oncol Biol Phys , 2006 , 65 : 1260 - 1269 . Int J Radiat Oncol Biol Phys Baler J M , Chen G T , Pelizzari C A , et al . Int Oncol Biol Phys , 1993 , 27 : 137 - 143 . Int Oncol Biol Phys http://www.aboutcancer.com/rtog_0418_protocol.htm http://www.aboutcancer.com/rtog_0418_protocol.htm Leunens G , Menten J , Weltens C , et al . Radiother Oncol , 1993 , 29 : 169 - 175 . Radiother Oncol http://www.aapm-scc.org/resources/Benedick_Fraass http://www.aapm-scc.org/resources/Benedick_Fraass Roger M and Tim M . J Clin Oncol , 1998 , 16 : 551 - 556 . J Clin Oncol Li F M , Nye Q , Wang R M . Nucl Med Biol , 2012 , 39 : 437 - 442 . Nucl Med Biol Voyanta C , Julianc D , Roustitd R , et al . Rep Prac Oncol Radiother , 2014 , 19 : 47 - 55 . Rep Prac Oncol Radiother Vykopalová H and Cupal M . Procedia-Soc Beha Scis , 2014 , 116 : 1665 - 1669 . Procedia-Soc Beha Scis Kim H L , Mus A , Wong J , et al . Int J Radiat Oncol Biol Phys , 2007 , 69 : 1305 - 1309 . Int J Radiat Oncol Biol Phys Hawkins M A , Aitken A , Hansen V N , et al . Radiothe Oncol , 2011 , 98 : 249 - 254 . Radiothe Oncol Ghilezan M , Yan D , Liang J , et al . Int J Radiat Oncol Biol Phys , 2004 , 60 : 1602 - 1610 . Int J Radiat Oncol Biol Phys Wu Y C , Liu P , Hu L Q , et al . Chin J Nucl Sci Eng , 2007 , 27 : 69 - 75 . (in Chinese) Chin J Nucl Sci Eng Wu Y C , Li G L , Tao S X , et al . Chin J Med Phys , 2005 , 22 : 683 - 690 . Chin J Med Phys Wu Y , Song G , Cao R , et al . Chinese Phys C , 2008 , 32 : 177 - 182 . Chinese Phys C Zheng H Q , Sun G Y , Li G , et al . Commun Comput Phys , 2013 , 14 : 1415 - 1422 . Commun Comput Phys 10.13538/j.1001-8042/nst.25.060501 Supported by National Natural Science Foundation of China (No. 81101132) and Natural Science Foundation of Anhui Province (No. 11040606Q55) 2014-04-24 2014-05-27 2014-12-20 2014-12-20 2021-04-11 2014 Nuclear Science and Techniques 6 25