Session Item

Clinical track: Lung
Poster
Clinical
15:45 - 15:50
Evaluating inter-observer variation in oesophageal target volume delineation
PD-0422

Abstract

Evaluating inter-observer variation in oesophageal target volume delineation
Authors: Nicholas|, Owen(1)*[owen.nicholas@wales.nhs.uk];Lewis|, Geraint(2);Thomas|, Betsan(3);Smyth|, Maeve(2);Spezi|, Emiliano(4);Gwynne|, Sarah Helene(1);
(1)Swansea Bay University Health Board, South West Wales Cancer Centre, Swansea, United Kingdom;(2)Velindre University NHS Trust, Departmenf of Physics- Velindre Cancer Centre, Cardiff, United Kingdom;(3)Velindre University NHS Trust, Department of Oncology- Velindre Cancer Centre, Cardiff, United Kingdom;(4)Cardiff University, School of Engineering, Cardiff, United Kingdom;
Show Affiliations
Purpose or Objective

Inter-observer variation in target volume delineation (TVD) is the most significant source of uncertainty in radiotherapy (RT). Variation in TVD can have a negative impact on survival. For clinical trials, RTQA is an essential component of delivering safe and effective RT by ensuring adherence to trial protocols. In the UK there have been two recent major clinical trials involving neoadjuvant RT in oesophageal cancer; the NeoSCOPE and Neo-AEGIS trials. Both use markedly different delineation protocols to generate similiar target volumes. This study aims to see if one protocol introduces more variation in delineated volumes, identify common sources of error or variation and provide insights to inform future protocols.

Material and Methods

Ten clinical oncologists with experience in upper GI cancers from across the UK were given two identical CT datasets (a mid and lower-third oesophagus case) with pre-delineated GTV. The clinicians were asked to generate target volumes (CTVA, CTVB, PTV) for each dataset using protocols from the NeoSCOPE and Neo-AEGIS studies. Submitted volumes were reviewed by an experienced RTQA clinician with protocol deviations identified. To evaluate the inter-observer concordance, the generalized conformity index (CIgen), defined as the ratio of the sum of all overlapping volumes between pairs of observers and the sum of all overlapping and all non-overlapping volumes between the same pairs, was used. A CIgen of 1 indicates 100% concordance and a CIgen of 0 indicates no concordance in delineation.

Results




Middle ThirdMiddle ThirdLower Third Lower Third 
VolumeNeoSCOPENeo-AEGISNeoSCOPENeo-AEGIS
CTVA0.930.950.92-
CTVB0.840.700.760.60
PTV0.840.770.810.67

Table 2: Generalised Conformity Index (CIgen) for CTVA, CTVB and PTV



Image 1: CTVB contours for lower third case below the gastro-oesophageal junction.

Conclusion

There was more TVD variation using the Neo-AEGIS protocol. For lower third cases, 6/10 cases had unacceptable variation from protocol. The most significant non-concordance was seen in the CTVB volume using the Neo-AEGIS protocol for lower third cases. Analysis of the protocols show that the NeoSCOPE uses systematic geometric expansion of GTV which is then edited back to generate CTVB. Neo-AEGIS uses anatomical landmarks to define the ’fat pad’ which forms the CTVB. Below the GOJ, both protocols use a ‘free-hand’ approach with anatomical landmarks to define CTVB. Both protocols included sample images, but in addition, NeoSCOPE included multiple worked examples.  

For future trial delineation protocols, we recommend utilising clear anatomical landmarks to avoid ambiguity when defining target volumes.  Where possible, we recommend utilising geometric expansion of GTV with editing and to limit the use of a ‘free-hand’ approach. We also recommend including images and multiple worked examples to reflect different cases and situations