2020 AAMD Plan Study

Recap, Review, and High Performers

July 22, 20187 minute read


The 2020 AAMD Plan Study was a great success! The meeting was virtual this year, so the cloud-based ProKnow software fit perfectly well and allowed international participation. Over 300 people registered, and over 140 submitted valid, composite plans in the allotted time.

This year’s clinical planning and presentation team was led by dosimetrists Chavanon Apinorasethkul, CMD, and Kalin Shipman, CMD. They provided the anonymized planning images and anatomical structure set. They also led the design of the metrics and plan scorecard, which featured a total of 24 metrics studied (20 of which were scored; 4 others collected for added analysis) for a total of 150 points.

The featured plan was a base of skull chordoma. Participants were to design and submit a sequential plan prescribed to a total of 77.4 Gy and made up of two fraction groups: 54 Gy in 30 fractions followed by 23.4 Gy in 13 fractions. Participants used a dedicated ProKnow domain (https://aamd.proknow.com), where they could upload their plan(s) and dose(s), sum them to create a composite plan (if necessary), render their scorecard, and iterate until they were happy with their performance. Scores were kept blind (i.e., participants could only see their own plan and score) up until the AAMD presentation which took place on July 6, 2020. (Note: Visit the AAMD website to get access to their presentation.)

The scorecard’s metrics and objectives were based on current clinical goals for this type of treatment without extra challenges for target coverage objectives or ALARA scoring for organs-at-risk. As a result, an impressive number of participants met every highest objective over all metrics to achieve perfect scores of 150 out of 150.

A list of “High Performers” was defined as any/all users who scored in one of the “top three bins” in terms of overall plan score histogram (in this case, that means a score greater than 137.50 out of 150). Please see the “High Performers Summary” section, below.

Interactive Review

We used a dedicated ProKnow “big data” repository and analytics domain for this study rather than the conventional Plan Study quality system technology. This offers some nice advantages:

  • Participants were able to sum their dose grids here to get their composite plan/score, when applicable.
  • This domain allows retrospective analysis and interactive visualization of each and every anonymized submission.
  • This domain also allows full navigation of population scorecards, histograms/variation per metric, and scatterplots/correlation for any pair of the derived or numeric custom metrics.

To study and analyze the results yourself, simply sign in to the domain, then use the many population analysis tools and of course the plan-by-plan analysis tools. The domain has been set to “read-only” mode, so you will not be able to edit contours, metrics, or scorecards, or upload any new data, but you can survey the plan submissions one-by-one or as a population.

Note: If you did not participate but would like to inspect and navigate the plans, doses, DVHs, scorecards, and population results, you can submit a request to Elekta/ProKnow team members at support@proknowsystems.com.

Figure 1 Histogram Scores
Figure 1. This is a histogram of the composite scores for the final valid, submitted plans. You can separate these by modality, TPS, or radiation type. You can also click on any bin to see all the plans whose metric fell in that bin. This goes for any derived or custom metric.
Figure 2 Collection Scorecard
Figure 2. Here is a snapshot of the plan scorecard extracted across the whole population of submitted plans. The variation of each metric’s result is shown as a box plot atop the scoring objectives. Any row can be selected (double-clicked) for drill-down analysis of the underlying data.
Figure 3 Scores by Modality
Figure 3. Condensed boxplot view of all plan scores filtered by modality.

High Performers Summary

Congratulations to all participants, and especially to the following individuals who scored in one of the top performance bins of this plan study.

Table 1. The following users scored in the “top three bins” in terms of total plan score. For the cohort of users who scored 150, the order in the table is set simply by alphabetical order based on first name.

150.00Alberto AdradaClinica de occidenteColombiaVMATEclipse
150.00Chun Long LeeSt. Teresa’s HopsitalHong KongVMATEclipse
150.00Dalibor LojkoNemocnica KomarnoSlovakiaIMRT (Dynamic)Eclipse
150.00Daniel SullivanGrand Valley StateUSAVMATEclipse
150.00David LittlejohnVarian Medical SystemsUSAVMATEclipse
150.00David StewartPrince of Wales HospitalAustraliaVMATRayStation
150.00Drew GranatowiczNebraska MedicineUSAVMATEclipse
150.00Friedemann HerberthKantonsspital St.GallenSwitzerlandVMATEclipse
150.00Gary Ka Yu TsoSt. Teresa’s HospitalHong KongVMATEclipse
150.00Igor ProkofevEuropean medical centerMoscowVMATEclipse
150.00James HenryWillis Knighton Cancer CenterUSAVMATRayStation
150.00Julien RollandInstitut Paoli Calmettes & CHICASFranceVMATRayStation
150.00Li Kai LeungSt Teresa’s HospitalHong KongVMATEclipse
150.00Luke MackowiakMountain States Medical PhysicsUSAVMATEclipse
150.00Madison NewkirkUniversity of ArkansasUSAVMATEclipse
150.00Mark ArendsRIFThe NetherlandsVMATRayStation
150.00Megan RodriguesWillis-KnightonUSAVMATRayStation
150.00Nicolas DepauwMassachusetts General HospitalUSAProtonsAstroid
150.00Perumal MuruganSri Shankara Cancer HospitalIndiaVMATEclipse
150.00Peter TreonRhode Island HospitalUSAVMATRayStation
150.00Richard ShoresPrisma Health – GHSUSAVMATEclipse
150.00Scott SenickVarian Medical SystemsUSAVMATEclipse
150.00Simon HeinzeKantonsspital St.GallenSwitzerlandVMATEclipse
150.00Siva KumarSri Shankara Cancer HospitalIndiaVMATEclipse
150.00Thomas Costantino, Frank Simac, Bruce Phillip21st Century OncologyUSAIMRT (Dynamic)Eclipse
150.00Yik Shing CheungHong King St. Teresa HospitalHong KongVMATEclipse
149.97Irina FotinaIBA DosimetryGermanyVMATMonaco
149.97Xuanfeng DingBeaumont Proton Therapy CenterUSAProtonsRayStation
149.88Sut I ChimSt. Teresa HospitalHong KongVMATEclipse
149.84Gajendran NRegency Hospital LtdIndiaVMATEclipse
149.78Tomas ProchazkaMasaryk Memorial Cancer InstituteCzech RepublicVMATEclipse
149.75Michael MastCommunity Howard Regional HealthUSAVMATEclipse
149.69Kazuyuki UeharaKobe Minimally Invasive Cancer CenterJapanVMATEclipse
149.62Matthew ThomasEmory HealthcareUSAVMATEclipse
149.27Mahmoud Al FishawyInternational Medical CenterEgyptVMATEclipse
149.04Alejandro RinconesInstituto del Cancer SOLCA CuencaEcuadorVMATEclipse
148.83Murali GovindarajKailash Cancer HospitalIndiaVMATEclipse
148.76Kirby DeLozierMoffitt Cancer CenterUSAVMATPinnacle
148.39Juan PerezQuironsalud Protontherapy CenterSpainProtonsRayStation
148.37Justin MillerMoffitt Cancer CenterUSAVMATPinnacle
148.16Raymond DalfsenElektaAustraliaProtonsMonaco
148.02Warwick MokHKSHHong KongHelical ArcTomoTherapy
147.78Aurelie SorsOncorad Garonne montaubanFranceVMATEclipse
147.54Mark BowersMoffitt Cancer CenterUSAVMATPinnacle
147.47Jessica CaselliNorthside HospitalUSAVMATEclipse
147.32Christopher AmalooConehealth Cancer CenterUSAVMATEclipse
147.32Lev HaimAssuta ashdod hospitalIsraelVMATEclipse
146.79Timothy HancockKantonsspital AarauSwitzerlandVMATEclipse
146.73Hisato NaganoShonan Fujisawa Tokushukai Hp.JapanVMATRayStation
146.62Lai mun YapBeacon hospitalMalaysiaVMATEclipse
145.99Paolo FerrariAzienda Sanitaria dell’Alto Adige – BolzanoItaliaVMATRayStation
145.86Barry MelanconOchsner HealthUSAVMATEclipse
145.80Tyler WilliamsonMD Anderson Proton Therapy CenterUSAVMATRayStation
145.65Brian NealProCureUSAProtonsRayStation
145.28C P BhattSarvoday Hospital Faridabad InidaIndiaVMATMonaco
145.06Junaid KhanVarianCanadaVMATEclipse
144.94Bruce HaPeter MacCallum Cancer CEentreAustraliaVMATEclipse
143.98Kevin GrecoMoffitt Cancer CenterUSAVMATRayStation
143.69Vanessa MagliariVarianUSAVMATEclipse
143.31Laertes PapaspyrouPhilips HealthcareGreeceProtonsPinnacle
142.67Eugene HoldmanAlexandrov National Cancer CenterBelarusIMRT (Dynamic)Eclipse
142.06Sergei RusetckiiLLC MedscanRussiaVMATEclipse
142.05Philip BowenAgnesian Cancer Center/SSMUSAVMATPinnacle
140.90Rick SchererElektaUSAVMATMonaco
140.82Bradley DuboisGoshen Center For Cancer CareUSAVMATEclipse
140.77Morgan GriffinHartford HealthcareUSAVMATEclipse
140.44Kadishe BalaziOSF Saint Francis Medical CenterUSAVMATEclipse
140.06Sarah JohnsonCincinnati Childrens/UC Health Proton CenterUSAProtonsEclipse
139.72Chung Yin MakSt Teresa’s hospitalHong KongVMATEclipse
139.39Matev MlekuInstitute of Oncology LjubljanaSloveniaVMATMonaco
139.34Helena AllonAssutaIsraelVMATEclipse
139.25Nadine HongAustin HealthAustraliaVMATMonaco
139.09Ellen KurdzoHartford HospitalUSAVMATEclipse
138.63Luis Fernando Paredes OcampoClinica de OccidenteColombiaVMATEclipse
138.57Pedro BorgesElektaBrazilVMATMonaco
138.49Ashley ChackalayilNorthside HospitalUSAVMATEclipse
138.06Maia TopeshashviliResearch Institute of Clinical MedicineGeorgiaVMATEclipse
138.02Zhanjia HouLMPUSAVMATEclipse