Artificial Intelligence

Mission

The Artificial Intelligence Group at the EngerLab, part of Mila – Quebec AI Institute, develops advanced machine learning methods to improve cancer diagnosis, treatment, and outcome prediction. Using multimodal patient data, including diagnostic imaging, digital pathology, and clinical text, we build models for organ segmentation, dose prediction, and optimization of treatment planning, with a particular focus on automating brachytherapy workflows. In parallel, we design outcome prediction models that apply broadly across all treatment types, supporting more personalized and effective cancer care. A major initiative is the development of a province-wide, AI-enabled data platform that harmonizes imaging, molecular, and clinical data to advance precision oncology across Quebec. Through our research and training activities such as the McMedHacks summer school, we are shaping the future of AI-driven personalized medicine.

 

Members

Alana
Alana
Hossein
Alana
juan_pic
Juan
Yujing
Sébastien

Projects

AI-based treatment planning for brachytherapy applications

Treatment plan optimization is a routine part of both external beam radiotherapy and high dose rate brachytherapy. High dose rate brachytherapy is a mode of internal radiotherapy in which a source of radiation is placed inside the tumor through hollow needles known as catheters (interstitial brachytherapy) or near the tumor through site specific applicators (intracavitary brachytherapy). For every patient, the process of treatment plan optimization ensures that the dose to the tumor region is sufficient while the dose to the surrounding organs at risk is minimal. Therefore, treatment plan optimization is a key process in ensuring positive radiotherapy outcome.
In interstitial high dose rate brachytherapy, treatment planning is a labor-intensive and time-consuming task. The treatment planning cannot begin before the patient is put under anesthesia and the catheters are inserted. This makes the process painful for the patient and costly for the hospital. In addition, the current optimization method only controls the amount of time for which the source dwells at a specific location inside a catheter. The number and the location of the catheters are not optimized.
Hossein investigates the use of reinforcement learning for optimizing the number and position of the catheters prior to catheter insertion, in addition to the dwell time optimization. This way, quality of the treatment will improve because the catheters will be inserted according to an optimized plan.

Deep Learning-Based Multimodality Treatment Outcome Prediction

Cancer is the leading cause of death in Canada. Radiotherapy is used in about half of all cancer treatments. However, it is clinically challenging to predict which patients will benefit from which treatment combination despite improved protocols, imaging techniques for cancer management, and combining various radiotherapy treatment modalities. An accurate method for predicting a patient’s likelihood of response may reduce unnecessary interventions, lower healthcare costs, and reduce side effects. Therefore, investigating how pre-treatment patient characteristics influence treatment efficacy as measured by post-treatment response is crucial. The aim of Yujing and Alana’s work  is to develop a patient-specific, machine learning-based multi-modal treatment outcome prediction model for patients suffering from gynecological cancers. Our group has recently shown that the patient-specific radiation dose response may be influenced by inter-patient variation in tumor nuclei size. Therefore, the models developed by Yujing and Alana will not only integrate diagnostic images such as Computed Tomography, Magnetic Resonance, and Ultrasound images to detect high-order features that determine treatment response on a patient-specific basis, but also tumor nucleus size and cell spacing data obtained from scanned digital images of histopathology slides. Correlation between cell morphology and treatment outcome will also be investigated

Inter-observer variability of the manual segmentation 

Alana is investigating the inter-observer variability of the manual segmentation of tumor regions in endoscopy images and its effect on treatment outcomes. Furthermore, they are developing a deep learning-based segmentation tool that can learn from multiple observers labels with high inter-observer variability.

AI-based dosimetry and catheter reconstruction for brachytherapy application

Brachytherapy is a form of radiotherapy where a sealed radiation source (seed) is placed inside or in close proximity of the tumor.  The treatment starts by a radiation oncologist inserting catheters or an applicator inside or in proximity of the clinical treatment volume. Once this is done, CT or MR scans of the area are acquired. Organs at risk and the tumor are contoured by a radiation oncologist and the catheters/applicator are manually reconstructed by a medical physicist on the image set. Finally an optimized treatment plan is created to deliver an optimal dose to the tumor while sparing organs at risk. However, before optimization of the treatment plan, the absorbed dose contribution per second from each possible seed position along a catheter (dwell position) is determined. This is done by using precalculated dose distributions around a single seed and scaling it with respect to the daily air kerma strength of the seed. 

The precalculated dose used by clinical treatment planning systems is based on the American Association of Physicists in Medicine (AAPM) Task Group 43 (TG-43) formalism which describes dose deposition around a single source centrally positioned in a spherical water phantom with unit density. The influence of patient tissue and applicator heterogeneities, intersource attenuation, and finite patient dimensions are ignored. Recently, more advanced model based dose calculation algorithms (MBDCAs) calculating dose to medium in medium have been developed. In MBDCAs, dose calculations are performed using the patient’s CT or MR images. Voxel-by-voxel assignment of tissue mass density and elemental composition is required. Tissue mass density is obtained from CT or synthetic CT images using a Hounsfield Unit (HU) to density calibration curve. Tissue composition and nominal mass density can also be assigned to contoured organs. Exact description of the source and applicator geometry, material composition, and nominal mass density is required as well. MBDCAs such as the Monte Carlo  method, provide a detailed and accurate method for calculation of absorbed dose in heterogeneous systems such as the human body however are too time consuming to be used in a clinical workflow.

The main goal of this project is to develop a precise and automated dosimetry algorithm that will take into account patient’s tissue/applicator heterogeneities and replace the time consuming Monte-Carlo simulations.

Incorporation of causal principles for credible predictions in precision oncology

Despite substantial interest, clinical uptake of machine learning based precision oncology has been slow. In particular, radiotherapy is generally still prescribed using a “one size fits all” approach. We hypothesize that this is largely due to avoidable bias and lack of interpretability in machine learning precision oncology models. We will therefore aim to generate more credible and reliable predictions by incorporating causal principles. We will integrate a priori causal domain knowledge to identify tumour-type-agnostic biomarkers for the prediction of radiotherapy response, we will create tools for bias quantification and mitigation, and we will develop causally constrained, interpretable machine learning strategies for precision oncology.

 

Deep Learning-based Patient-Specific Outcome Survival  Prediction using inter-treatment multimodal data

My thesis explores how artificial intelligence can be used to better predict how long cancer patients remain free of disease after treatment by combining digital pathology slides with clinical information. Instead of focusing on a single algorithm, it develops a progression of models that move from establishing strong multimodal baselines, to making predictions more interpretable for clinicians, to creating new transformer-based methods that handle the scale and complexity of pathology images, and finally to using unsupervised learning to identify the most informative regions of tissue without manual labels. Taken together, the work contributes both technical advances and conceptual frameworks aimed at making survival prediction models more accurate, transparent, and ultimately usable in real-world oncology decision making.

McMedHacks

McMedHacks is an eight-week-long program that aims to teach students, researchers, and clinicians fundamentals of medical image analysis and deep learning in Python. This comprehensive program features weekly workshops, demos, and seminars conducted by leaders in the field. Our primary objective is to equip newcomers with the essential skills required for medical image analysis and deep learning, thereby fostering accelerated research in this critical domain.

Learn more

Publications

54 entries « 1 of 2 »

2025

Duran, Juan; Zou, Yujing; Vallières, Martin; Enger, Shirin A.

Beyond single-run metrics with CP-fuse: A rigorous multi-cohort evaluation of clinico-pathological fusion for improved survival prediction in TCGA Journal Article

In: Machine Learning with Applications, vol. 22, no. 100789, 2025, ISSN: 2666-8270.

Abstract | Links | BibTeX

Quetin, Sébastien; Jafarzadeh, Hossein; Kalinowski, Jonathan; Bekerat, Hamed; Bahoric, Boris; Maleki, Farhad; Enger, Shirin A.

Automatic catheter digitization in breast brachytherapy Journal Article

In: Medical Physics, vol. 52, iss. 9, no. e18107, 2025, ISSN: 2473-4209.

Abstract | Links | BibTeX

Zou, Yujing; Glickman, Harry; Pelmus, Manuela; Maleki, Farhad; Bahoric, Boris; Lecavalier-Barsoum, Magali; Enger, Shirin A.

Tumour nuclear size heterogeneity as a biomarker for post-radiotherapy outcomes in gynecological malignancies Journal Article

In: Physics and Imaging in Radiation Oncology, vol. 35, no. 100793, 2025, ISSN: 2405-6316.

Abstract | Links | BibTeX

Morén, Björn; Jafarzadeh, Hossein; Enger, Shirin A

A data-driven approach to model spatial dose characteristics for catheter placement of high dose-rate brachytherapy for prostate cancer Journal Article

In: Computers in Biology and Medicine, vol. 190, no. 110020, 2025, ISSN: 1879-0534.

Abstract | Links | BibTeX

Thibodeau-Antonacci, Alana; Popovic, Marija; Ates, Ozgur; Hua, Chia-Ho; Schneider, James; Skamene, Sonia; Freeman, Carolyn; Enger, Shirin Abbasinejad; Tsui, James Man Git

Trade-off of different deep learning-based auto-segmentation approaches for treatment planning of pediatric craniospinal irradiation autocontouring of OARs for pediatric CSI Journal Article

In: Medical Physics, vol. 52, iss. 6, pp. 3541–3556, 2025, ISSN: 2473-4209.

Abstract | Links | BibTeX

Morén, Björn; Thibodeau-Antonacci, Alana; Kalinowski, Jonathan; Enger, Shirin A.

Dosimetric impact of positional uncertainties and a robust optimization approach for rectal intensity-modulated brachytherapy Journal Article

In: Medical Physics, vol. 52, iss. 6, pp. 3528–3540, 2025, ISSN: 0094-2405.

Abstract | Links | BibTeX

2024

Jafarzadeh, Hossein; Antaki, Majd; Mao, Ximeng; Duclos, Marie; Maleki, Farhard; Enger, Shirin A

Penalty weight tuning in high dose rate brachytherapy using multi-objective Bayesian optimization Journal Article

In: Physics in Medicine & Biology, vol. 69, 2024.

Links | BibTeX

2023

Amod, Alyssa R.; Smith, Alexandra; Joubert, Pearly; Sebastien, Quetin

2nd Place at BraTS Africa 2023 Challenge Miscellaneous

2023, (MICCAI 2023 ).

Links | BibTeX

Sebastien, Quetin; Bahoric, Boris; Maleki, Farhad; Enger, Shirin A.

Improving TG-43 dose accuracy with Deep Learning Conference

2023, (CARO-COMP 2023 Joint Scientific Meeting ).

Links | BibTeX

Sebastien, Quetin; Bahoric, Boris; Maleki, Farhad; Enger, Shirin A.

Artificial-Intelligence based high precision Brachytherapy dose calculation, Presentation

21.06.2023, (Temerty Centre for AI Research and Education in Medicine, University of Toronto ).

Links | BibTeX

Jafarzadeh, Hossein

Doctoral Internship Award Miscellaneous

2023, (Graduate and Post Doctoral Studies, McGill University ).

BibTeX

Sebastien, Quetin; Bahoric, Boris; Maleki, Farhad; Enger, Shirin A.

Artificial-Intelligence based high precision Brachytherapy dose calculation Presentation

13.05.2023, (The European Society for Radiotherapy and Oncology 2023 Congress ).

Links | BibTeX

Sebastien, Quetin

Lady Davis Institute Travel Award Miscellaneous

2023, (Lady Davis Institute ).

BibTeX

2022

Sebastien, Quetin

Artificial Intelligence-based Brachytherapy Presentation

From New avenues in the non-operative management of patients with rectal cancer Conference, 14.10.2022.

BibTeX

Zou, Yujing

TransMedTech Excellence Scholarship (Doctoral Award) Journal Article

In: 2022.

Links | BibTeX

Sebastien, Quetin; Zou, Yujing

Deep Learning Framework : Tensorboard and Pytorch Lightning Workshop

2022.

Links | BibTeX

Zou, Yujing; Alvarez, David-Santiago Ayala

ESTRO 2022: innovations in brachytherapy Journal Article

In: ESTRO Newsletter, pp. 754–767, 2022.

Links | BibTeX

Sebastien, Quetin

Deep Learning Framework : Pytorch tensors and Autograd Workshop

2022.

Links | BibTeX

Sebastien, Quetin; Bahoric, Boris; Maleki, Farhad; Enger, Shirin A.

rtificial Intelligence-based dosimetry in high dose rate brachytherapy Conference

2022, (Celebration of Research and Training in Oncology Conference ).

BibTeX

Sebastien, Quetin; Zou, Yujing

Introduction to medical image processing with Python : DICOM and histopathology images Workshop

2022.

Links | BibTeX

Zou, Yujing

Fonds de recherche du Québec - Nature et technologies (FRQNT) PhD doctoral training scholarship award

2022, ($84,000 for 2022 - 2026; Declined due to acceptance of FRQS).

Links | BibTeX

Zou, Yujing

Fonds de recherche du Québec - Santé (FRQS) PhD doctoral training scholarship award

2022, ($84,000 for 2022 - 2026).

Links | BibTeX

Zou, Yujing; Lecavalier-Barsoum, Magali; Pelmus, Manuela; Maleki, Farhad; Enger, Shirin A.

Predictive modeling of post radiation-therapy recurrence for gynecological cancer patients using clinical and histopathology imaging features Conference

Curietherapies 2022.

Abstract | Links | BibTeX

Zou, Yujing; Lecavalier-Barsoum, Magali; Pelmus, Manuela; Maleki, Farhad; Enger, Shirin A.

Young Investigator Competition Winner at the Curietherapies Conference award

2022.

Abstract | Links | BibTeX

Zou, Yujing

Biological & Biomedical Engineering PhD Recruitment Award award

2022, (These awards are designed to help recruit top students to our program and are offered to applicants wishing to start in Fall or Winter. The standard recruitment awards are $10,000/year for three years for Doctoral students.).

Links | BibTeX

Jafarzadeh, Hossein

Biological & Biomedical Engineering PhD Recruitment Award award

2022.

Links | BibTeX

Zou, Yujing

Graduate Research Enhancement and Travel Awards (GREAT Awards) award

2022, (In 2009, Graduate and Postdoctoral Studies introduced the Graduate Research Enhancement and Travel awards (GREAT awards) program in consultation with the Faculty Deans and Associate Deans. These awards cover dissemination of research through graduate student presentations at conferences, and other graduate student research-enhancement activities, such as travel for fieldwork, archival inquiry and extra-mural collaborative research. GREAT budgets are allocated to Faculties each year, and as such, are managed directly by the Associate Dean's office.).

Links | BibTeX

Weishaupt, Luca L.; Sayed, Hisham Kamal; Mao, Ximeng; Choo, Richard; Stish, Bradley J; Enger, Shirin A; Deufel, Christopher

Approaching automated applicator digitization from a new angle: Using sagittal images to improve deep learning accuracy and robustness in high-dose-rate prostate brachytherapy Journal Article

In: Brachytherapy, 2022.

BibTeX

Jafarzadeh, Hossein; Mao, Ximeng; Enger, Shirin A.

Bayesian Optimization in Treatment Planning of High Dose Rate Brachytherapy Proceedings Article

In: MEDICAL PHYSICS, pp. E200–E200, WILEY 111 RIVER ST, HOBOKEN 07030-5774, NJ USA 2022.

BibTeX

Zou, Yujing; Lecavalier-barsoum, Magali; Pelmus, Manuela; Enger, Shirin A.

Patient-Specific Nuclei Size and Cell Spacing Distribution Extraction From Histopathology Whole Slide Images for Treatment Outcome Prediction Modelling Proceedings Article

In: MEDICAL PHYSICS, pp. E266–E266, WILEY 111 RIVER ST, HOBOKEN 07030-5774, NJ USA 2022.

Abstract | Links | BibTeX

Zou, Yujing; Weishaupt, Luca; Enger, Shirin A.

SP-0014 McMedHacks: Deep learning for medical image analysis workshops and Hackathon in radiation oncology Journal Article

In: Radiotherapy and Oncology, vol. 170, pp. S4–S5, 2022.

Abstract | Links | BibTeX

Weishaupt, Luca L.; Vuong, Te; Thibodeau-Antonacci, Alana; Garant, A; Singh, K; Miller, C; Martin, A; Schmitt-Ulms, F; Enger, Shirin A.

PO-1325 Automated rectal tumor segmentation with inter-observer variability-based uncertainty estimates Journal Article

In: Radiotherapy and Oncology, vol. 170, pp. S1120–S1121, 2022.

BibTeX

Weishaupt, Luca L; Vuong, Te; Thibodeau-Antonacci, Alana; Garant, A; Singh, KS; Miller, C; Martin, A; Enger, Shirin A.

A121 QUANTIFYING INTER-OBSERVER VARIABILITY IN THE SEGMENTATION OF RECTAL TUMORS IN ENDOSCOPY IMAGES AND ITS EFFECTS ON DEEP LEARNING Journal Article

In: Journal of the Canadian Association of Gastroenterology, vol. 5, no. Supplement_1, pp. 140–142, 2022.

BibTeX

Thibodeau-Antonacci, Alana; Vuong, Te; Liontis, B; Rayes, F; Pande, S; Enger, Shirin A.

Development of a Novel MRI-Compatible Applicator for Intensity Modulated Rectal Brachytherapy Proceedings Article

In: MEDICAL PHYSICS, pp. E240–E240, WILEY 111 RIVER ST, HOBOKEN 07030-5774, NJ USA 2022.

BibTeX

Thibodeau-Antonacci, Alana; Enger, Shirin A.; Bekerat, Hamed; Vuong, Te

Gafchromic film and scintillator detector measurements in phantom with a novel intensity-modulated brachytherapy endorectal shield Proceedings Article

In: MEDICAL PHYSICS, pp. 5688–5689, WILEY 111 RIVER ST, HOBOKEN 07030-5774, NJ USA 2022.

BibTeX

2021

Weishaupt, Luca L.

T I Gurman Prize in Physics award

2021.

Abstract | Links | BibTeX

Thibodeau-Antonacci, Alana

Canada Graduate Scholarship – Doctoral Program award

2021.

Links | BibTeX

Weishaupt, Luca L.; Thibodeau-Antonacci, Alana; Garant, Aurelie; Singh, Kelita; Miller, Corey; Vuong, Té; Enger, Shirin A.

Deep learning based tumor segmentation of endoscopy images for rectal cancer patients Presentation

ESTRO Annual meeting, 27.08.2021.

Abstract | Links | BibTeX

Thibodeau-Antonacci, Alana; Jafarzadeh, Hossein; Carroll, Liam; Weishaupt, Luca L.

Mitacs Globalink Research Award award

2021.

Abstract | Links | BibTeX

Weishaupt, Luca L.; Thibodeau-Antonacci, Alana; Garant, Aurelie; Singh, Kelita; Miller, Corey; Vuong, Té; Enger, Shirin A.

Inter-Observer Variability and Deep Learning in Rectal Tumor Segmentation from Endoscopy Images Presentation

The COMP Annual Scientific Meeting 2021, 22.06.2021.

Abstract | BibTeX

Morcos, Marc; Antaki, Majd; Thibodeau-Antonacci, Alana; Kalinowski, Jonathan; Glickman, Harry; Enger, Shirin A.

RapidBrachyMCTPS: An open-source dose calculation and optimization tool for brachytherapy research Presentation

COMP, 01.06.2021.

BibTeX

Thibodeau-Antonacci, Alana; Vuong, Té; Bekerat, Hamed; Liang, Liheng; Enger, Shirin A.

Development of a Dynamic Shielding Intensity-Modulated Brachytherapy Applicator for the Treatment of Rectal Cancer award

2021.

Abstract | Links | BibTeX

Weishaupt, Luca L.; Torres, Jose; Camilleri-Broët, Sophie; Rayes, Roni F.; Spicer, Jonathan D.; Maldonado, Sabrina Côté; Enger, Shirin A.

Deep learning-based tumor segmentation on digital images of histopathology slides for microdosimetry applications Journal Article

In: arXiv:2105.01824 [physics], 2021, (arXiv: 2105.01824).

Abstract | Links | BibTeX

Thibodeau-Antonacci, Alana; Vuong, Té; Bekerat, Hamed; Childress, Lilian; Enger, Shirin A.

OC-0112 development of a dynamic-shielding intensity modulated endorectal brachytherapy applicator Presentation

Radiotherapy and Oncology, 01.05.2021, ISBN: 0167-8140, 1879-0887.

Abstract | Links | BibTeX

Zou, Yujing; Lecavalier-Barsoum, Magali; Enger, Shirin A.

Treatment outcome Prediction for gynecological cancers patients with a machine learning model using pre/post diagnostic image modalities and digital histopathology images Presentation

CRUK RadNet Manchester AI for Optimising Radiotherapy Outcomes Workshop, 10.02.2021.

Abstract | BibTeX

Weishaupt, Luca L.

Fire-Up - Radiation Treatment Outcome Prediction Presentation

Fire-Up Presentation, 09.02.2021.

BibTeX

Weishaupt, Luca L.; Sayed, Hisham Kamal; Mao, Ximeng; Choo, Chunhee; Stish, Bradley; Enger, Shirin A.; Deufel, Christopher

Approaching automated applicator digitization from a new angle: using sagittal images to improve deep learning accuracy and robustness in high-dose-rate prostate brachytherapy Journal Article

In: 2021 ABS Annual Meeting, 2021, (Type: Journal Article).

BibTeX

Deufel, Christopher; Weishaupt, Luca L.; Sayed, Hisham Kamal; Choo, Chunhee; Stish, Bradley

Deep learning for automated applicator reconstruction in high-dose-rate prostate brachytherapy Journal Article

In: World Congress of Brachytherapy 2021, 2021, (Type: Journal Article).

Links | BibTeX

2020

Mao, Ximeng; Pineau, Joelle; Keyes, Roy; Enger, Shirin A.

RapidBrachyDL: Rapid Radiation Dose Calculations in Brachytherapy Via Deep Learning Journal Article

In: International Journal of Radiation Oncology, Biology, Physics, vol. 108, no. 3, pp. 802–812, 2020, ISSN: 1879-355X.

Abstract | Links | BibTeX

Zou, Yujing

Graduate Excellence Fellowship award

2020.

BibTeX

54 entries « 1 of 2 »