Carlos Jorge Andrade Mariz Santiago (6016-3A42-8D46)

Curriculum Vitae

Carlos Jorge Andrade Mariz Santiago

Carlos Santiago is an assistant researcher at Institute for Systems and Robotics (ISR/LARSyS) and Invited Assistant Professor at Instituto Superior Tecnico (IST). He has a MSc in Biomedical Engineering and a PhD in Electrical and Computer Engineering from IST, Universidade de Lisboa. Over the past few years, Carlos has worked on several research topics related to image analysis, computer vision, and machine learning, pushing the scientific envelope in key areas such as healthcare and smart cities. These topics are being addressed in the scope of both national and international projects in collaboration with health institutions, industry partners, and other research centers. Specifically, he is working on: breast cancer detection, with Hospital Fernando Fonseca; cardiac MRI segmentation, with Luz Saude; skin cancer prognosis, with I3S Ipatimup; video analysis from multiple cameras, with Italy's National Research Council; efficient deep learning strategies, with the Australian Institute for Machine Learning; and multimodal retrieval and recommendation in e-commerce, with Carnegie Mellon University, Universidade Nova de Lisboa, and FARFETCH. His contribution to these projects is on the development of artificial intelligence systems to help humans seamlessly process large amounts of data using AI. In this context, Carlos has already published 11 papers in top international journals (including 3 papers in IEEE TIP and 1 in IEEE PAMI) and over 20 papers in international conferences. Nowadays, most state-of-the-art methods in computer vision rely on deep neural networks (DNNs). Through his experience with the ongoing projects, Carlos believes that, while DNNs achieve outstanding results, they face a major challenge in real-world problems: most training datasets are either too small, imbalanced, or noisy for DNNs to reach their full potential. These drawbacks will hamper technology transfer of this type of AI models to our everyday life. His research interests aim to address the above challenges by making the learning process of DNNs more efficient and robust, while making these models more interpretable. Achieving these goals has the potential to boost the success of deep learning on many real-world applications.

Read full resume ↓

Identification

Personal identification

Full name: Carlos Jorge Andrade Mariz Santiago

Citation names

Santiago, Carlos

Author identifiers

Ciência ID: 6016-3A42-8D46
ORCID iD: 0000-0002-4737-0020
Google Scholar ID: f17rSrgAAAAJ
Scopus Author Id: 55249635100

Email addresses

carlos.santiago@tecnico.ulisboa.pt (Professional)

Telephones

Telephone

218418270 (Professional)

Addresses

Instituto Superior Técnico. Av. Rovisco Pais, 1, 1049-001, Lisboa, Lisboa, Portugal (Professional)

Websites

https://sites.google.com/tecnico.ulisboa.pt/carlossantiago (Professional)
https://scholar.google.com/citations?user=f17rSrgAAAAJ&hl=en (Scholar)

Knowledge fields

Engineering and Technology - Medical Engineering
Engineering and Technology - Electrotechnical Engineering, Electronics and Informatics

Languages

Language	Speaking	Reading	Writing	Listening	Peer-review
Portuguese (Mother tongue)
English	Advanced (C1)	Advanced (C1)	Advanced (C1)	Advanced (C1)	Advanced (C1)

Education

	Degree	Classification
2017/07/07 Concluded	Engenharia Eletrotécnica e de Computadores (Doutoramento) Universidade de Lisboa Instituto Superior Técnico, Portugal "Segmentation of the Left Ventricle in Cardiac Magnetic Resonance" (THESIS/DISSERTATION)	Pass with Distinction and Honour
2011/11/04 Concluded	Engenharia Biomédica (Mestrado integrado) Universidade de Lisboa Instituto Superior Técnico, Portugal "Adjustment of Deformable Models to Organ Surfaces in 3D Images" (THESIS/DISSERTATION)	15

Affiliation

Science

	Category Host institution	Employer
2023/09/01 - Current	Research Assistant (Research)	Laboratório de Robótica e Sistemas de Engenharia, Portugal

2023/04/17 - 2023/08/31	Contracted Researcher (Research)	Fundação para a Ciência e a Tecnologia, Portugal
	Laboratório de Robótica e Sistemas de Engenharia, Portugal
2021/02/01 - 2023/04/16	Contracted Researcher (Research)	Laboratório de Robótica e Sistemas de Engenharia, Portugal

2017/08/18 - 2021/01/31	Postdoc (Research)	Laboratório de Robótica e Sistemas de Engenharia, Portugal

2017/05/18 - 2017/08/17	Researcher (Research)	Laboratório de Robótica e Sistemas de Engenharia, Portugal

Teaching in Higher Education

	Category Host institution	Employer
2020/09/01 - Current	Invited Assistant Professor (University Teacher)	Universidade de Lisboa Instituto Superior Técnico, Portugal

Others

	Category Host institution	Employer
2013/05/01 - 2017/04/30	PhD Grant	Fundação para a Ciência e a Tecnologia, Portugal

2012/02/01 - 2013/04/30	Researcher - "HEARTRACK" project	Laboratório de Robótica e Sistemas de Engenharia, Portugal

2011/05/01 - 2011/10/31	Research grant - "HEARTRACK" project	Laboratório de Robótica e Sistemas de Engenharia, Portugal

2010/02/01 - 2010/06/30	Research grant - "Dyablo" project	Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa, Portugal

Projects

Grant

	Designation	Funders
2018/01/01 - 2019/12/31	MULTIDRONE: MULTIple DRONE platform for media production 731667 Post-doc Laboratório de Robótica e Sistemas de Engenharia, Portugal University of Bristol, United Kingdom Thales Communications and Security SAS, France Aristotle University of Thessaloniki, Greece Universidad de Sevilla, Spain Deutsche Welle, Germany Radiotelevisione Italiana, Italy	EU Framework Programme for Research and Innovation ICT Leadership in Enabling and Industrial Technologies Concluded
2016/07/01 - 2019/12/31	SPARSIS: SPARSE MODELING AND ESTIMATION OF MOTION FIELDS PTDC/EEI-PRO/0426/2014 Post-doc Laboratório de Robótica e Sistemas de Engenharia, Portugal Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa, Portugal Instituto de Telecomunicações, Portugal	Fundação para a Ciência e a Tecnologia Concluded
2017/08/18 - 2018/12/31	Laboratory for Robotics and Engineering Systems info:eu-repo/grantAgreement/FCT/5876/147329/PT Post-doc Fellow Laboratório de Robótica e Sistemas de Engenharia, Portugal	Fundação para a Ciência e a Tecnologia Concluded
2010/02/01 - 2010/06/28	Dyablo: Models for the Dynamic Behavior of Biological Networks info:eu-repo/grantAgreement/FCT/3599-PPCDT/71587/PT Master Student Fellow Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento em Lisboa, Portugal	Fundação para a Ciência e a Tecnologia Concluded

Contract

	Designation	Funders
2023/09 - Current	Multiple Instance Attention Learning for Multimodal Breast Cancer Diagnosis (MIA-BREAST) 1801P.01295.1.01 2022.04485.PTDC Associação do Instituto Superior Técnico para a Investigação e Desenvolvimento, Portugal	Fundação para a Ciência e a Tecnologia Ongoing
2023/01/01 - 2029/12/31	Efficient Deep Learning Strategies for Real-World Datasets 2022.07849.CEECIND Principal investigator Fundação para a Ciência e a Tecnologia, Portugal	Fundação para a Ciência e a Tecnologia Ongoing
2025/02/01 - 2026/01/31	Integration of an Artificial Intelligence Agent in Radiology to Assist in Breast Cancer Diagnosis 10.54499/2024.07344.IACDC Principal investigator Associação do Instituto Superior Técnico para a Investigação e Desenvolvimento, Portugal Centro Hospitalar de Trás-os-montes e Alto Douro EPE, Portugal	Fundação para a Ciência e a Tecnologia Ongoing
2022/01/01 - 2024/12/31	PT Smart Retail: Portugal como referência para a nova geração de retalho autónomo e inteligente 02/C05-i01.01/2022.PC645440011-00000062 Researcher	Ongoing
2020/01/01 - 2023/12/31	Laboratory of Robotics and Engineering Systems UIDP/50009/2020 10.54499/UIDP/50009/2020 Laboratório de Robótica e Sistemas de Engenharia, Portugal Universidade de Lisboa Instituto Superior Técnico, Portugal Associação do Instituto Superior Técnico para a Investigação e Desenvolvimento, Portugal Agência Regional para o Desenvolvimento da Investigação Tecnologia e Inovação, Portugal	Fundação para a Ciência e a Tecnologia Concluded
2020/09/01 - 2023/08/31	iFetch - Multimodal conversational agents for the online fashion market-place 45920 Researcher Laboratório de Robótica e Sistemas de Engenharia, Portugal Universidade Nova de Lisboa, Portugal Carnegie Mellon University, United States	Agência Nacional de Inovação SA European Regional Development Fund Autoridade de Gestão do Programa Operacional Competitividade e Internacionalização Fundação para a Ciência e a Tecnologia Concluded
2019/02/01 - 2022/12/31	AI4EU: a European Large Collaborative AI Platform and Ecosystem 825619 Post-doc Laboratório de Robótica e Sistemas de Engenharia, Portugal	EU Framework Programme for Research and Innovation ICT Leadership in Enabling and Industrial Technologies Concluded
2019/01/01 - 2019/12/31	Laboratório de Robótica e Sistemas de Engenharia UID/EEA/50009/2019 LA/P/0083/2020 10.54499/LA/P/0083/2020 Laboratório de Robótica e Sistemas de Engenharia, Portugal Associação do Instituto Superior Técnico para a Investigação e Desenvolvimento, Portugal Universidade de Lisboa Centro de Ciência e Tecnologia do Ambiente e do Mar, Portugal Agência Regional para o Desenvolvimento da Investigação Tecnologia e Inovação, Portugal Universidade do Porto Faculdade de Engenharia, Portugal	Fundação para a Ciência e a Tecnologia Concluded
2012/02/01 - 2013/04/30	HEARTRACK - Segmentation and tracking of the human heart in 2D and 3D ultrasound data based on a principled combination of the top-down and bottom-up paradigms PTDC/EEA-CRO/103462/2008 PhD Student Fellow Laboratório de Robótica e Sistemas de Engenharia, Portugal	Fundação para a Ciência e a Tecnologia Concluded

Outputs

Publications

Book chapter	Matos, Gonçalo P.; Oliveira, Tiago G.; Silva, Filipe; Martinho, Francisco; Leão, Miguel; Fonseca, Filipe; Silvestre, José; et al. "An Apple Counting System Robust to Multiple Intermittent Occlusions". In Progress in Artificial Intelligence, 181-192. Springer Nature Switzerland, 2024. 10.1007/978-3-031-73497-7_15 Santiago, Carlos; Correia, Miguel; Verdelho, Maria Rita; Bissoto, Alceu; Barata, Catarina. "Global and Local Explanations for Skin Cancer Diagnosis Using Prototypes". In Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 Workshops, 47-56. Springer Nature Switzerland, 2023. 10.1007/978-3-031-47401-9_5 Correia, Miguel; Bissoto, Alceu; Santiago, Carlos; Barata, Catarina. "XAI for Skin Cancer Detection with Prototypes and Non-Expert Supervision". In Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 Workshops. Springer Nature Switzerland, 2023. Catarina Barata; Carlos Santiago. "Improving the Explainability of Skin Cancer Diagnosis Using CBIR". 2021. 10.1007/978-3-030-87199-4_52 Medley, Daniela; Santiago, Carlos; Nascimento, Jacinto C.. "Robust Feature Descriptors for Object Segmentation Using Active Shape Models". In Advanced Concepts for Intelligent Vision Systems, 163-174. Springer International Publishing, 2018. 10.1007/978-3-030-01449-0_14 Marques, Jorge S.; Santiago, Carlos; Nascimento, Jacinto C.. "A 3D active shape model for left ventricle segmentation in MRI". In Biomedical Image Segmentation, 99-115. CRC Press, 2016. 10.4324/9781315372273-5 "A 3D active shape model for left ventricle segmentation in MRI". 99-115. CRC Press, 2016. Santiago, Carlos; Nascimento, Jacinto C.; Marques, Jorge S.. "Robust 3D Active Shape Model for the Segmentation of the Left Ventricle in MRI". In Pattern Recognition and Image Analysis, 283-290. Springer International Publishing, 2015. 10.1007/978-3-319-19390-8_32 Santiago, Carlos; Nascimento, Jacinto C.; Marques, Jorge S.. "Non-rigid Object Segmentation Using Robust Active Shape Models". In Articulated Motion and Deformable Objects, 160-169. Springer International Publishing, 2014. 10.1007/978-3-319-08849-5_16 Marques, Jorge S.; Nascimento, Jacinto C.; Santiago, Carlos. "Robust Deformable Models for 2D and 3D Shape Estimation". In Lecture Notes in Computational Vision and Biomechanics, edited by Gonz{\'a, 169-185. Springer Netherlands, 2012. 10.1007/978-94-007-5446-1_7
Conference abstract	Carmona, Joana; Abreu, Rodolfo; Santiago, Carlos; Leal, Alberto; Nascimento, Jacinto C.; Figueiredo, Patrícia. "Classification of epileptic states from fMRI dynamic functional connectivity using machine learning". Paper presented in 2019 Organization for Human Brain Mapping (OHBM) Annual Meeting, 2019. Submitted Carmona, Joana; Abreu, Rodolfo; Santiago, Carlos; Leal, Alberto; Nascimento, Jacinto C.; Figueiredo, Patrícia. "Classification of sleep stages from fMRI dynamic functional connectivity using deep learning". Paper presented in 27th Annual Meeting of the International Society for Magnetic Resonance in Medicine (ISMRM), 2019. Published
Conference paper	Araújo, Diogo; Verdelho, MR; Bissoto, Alceu; Jacinto C Nascimemto; Santiago, Carlos; Barata, Catarina. "Key Patches Are All You Need: A Multiple Instance Learning Framework For Robust Medical Diagnosis". Paper presented in CVPR 2024: Workshop on Domain adaptation, Explainability, Fairness in AI for Medical Image Analysis (DEF-MIA-AI 2024), Seattle, Washington, USA, 2024. Accepted Gonçalo Matos; Santiago, Carlos; Costeira, JP; Saldanha, Ricardo; Ernesto Morgado. "Tracking and Counting Apples in Orchards Under Intermittent Occlusions and Low Frame Rates". Paper presented in CVPR Workshop on Vision for Agriculture, 2024. Tiago Mota; Verdelho, Maria Rita; Diogo José Pereira Araújo; Alceu Bissoto; Santiago, Carlos; Barata, Catarina. "MMIST-ccRCC: A Real World Medical Dataset for the Development of Multi-Modal Systems". Paper presented in CVPR Data Curation and Augmentation in Enhancing Medical Imaging Applications Workshop, 2024. Lino, Filipa; Santiago, Carlos; Marques, Manuel. "3D Human Pose Estimation with Occlusions: Introducing BlendMimic3D Dataset and GCN Refinement". Paper presented in CVPR Workshop and Competition on Affective Behavior Analysis in-the-wild, 2024. Miguel Cardoso; Santiago, Carlos; Jacinto C. Nascimento. "Using Counterfactual Information for Breast Classification Diagnosis". Paper presented in CVPR Domain adaptation, Explainability, Fairness in AI for Medical Image Analysis, 2024. Ciampi, Luca; Santiago, Carlos; Costeira, Joao; Falchi, Fabrizio; Gennaro, Claudio; Amato, Giuseppe. "Unsupervised Domain Adaptation for Video Violence Detection in the Wild". 2023. 10.5220/0011965300003497 Calisto, Francisco Maria; Fernandes, João; Morais, Margarida; Santiago, Carlos; Abrantes, João Maria; Nunes, Nuno; Nascimento, Jacinto C.. "Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis". 2023. 10.1145/3544548.3580682 Golub, M.; Santiago, Carlos; Baleia, C.; Lopes, P.; Ferreira, A. M.; Nunes, R. G.; Nascimento, J. C.. "Convolutional Siamese Networks for Myocardial Lesion Classification in T1 Maps". Paper presented in IEEE International Symposium on Biomedical Imaging (ISBI), 2023. 10.1109/isbi53787.2023.10230508 Diogo, Pedro; Morais, Margarida; Calisto, Francisco Maria; Santiago, Carlos; Aleluia, Clara; Nascimento, Jacinto C.. "Weakly-Supervised Diagnosis and Detection of Breast Cancer Using Deep Multiple Instance Learning". Paper presented in IEEE International Symposium on Biomedical Imaging (ISBI), 2023. 10.1109/isbi53787.2023.10230448 Morais, Margarida; Calisto, Francisco Maria; Santiago, Carlos; Aleluia, Clara; Nascimento, Jacinto C.. "Classification of Breast Cancer in Mri with Multimodal Fusion". Paper presented in IEEE International Symposium on Biomedical Imaging (ISBI), 2023. 10.1109/isbi53787.2023.10230686 João Bernardo Morais; Santiago, Carlos; Costeira, Joao Paulo. "Say Yes To The Fetch: Product Retrieval on a Structured Multimodal Catalog.". Paper presented in AI2ASE Workshop at the AAAI Conference on Artificial Intelligence. 2022, 2022. Sousa, Ricardo Gamelas; Ferreira, Pedro Miguel; Costa, Pedro Moreira; Azevedo, Pedro; Costeira, Joao Paulo; Santiago, Carlos; Magalhaes, Joao; et al. "iFetch". 2021. 10.1145/3475959.3485395 Magalhaes, Joao; Hauptmann, Alexander G.; Sousa, Ricardo G.; Santiago, Carlos. "MuCAI'21: 2nd ACM Multimedia Workshop on Multimodal Conversational AI". 2021. 10.1145/3474085.3478580 Luca Ciampi; Santiago, Carlos; Costeira, JP; Claudio Gennaro; Giuseppe Amato. "Domain Adaptation for Traffic Density Estimation". Paper presented in International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP), 2021. Barata, Catarina; Santiago, Carlos. "How Important Is Each Dermoscopy Image?". Paper presented in Workshop at IEEE Computer Vision and Pattern Recognition, 2020. Published • 10.1109/cvprw50498.2020.00379 Luca Ciampi; Santiago, Carlos; João Paulo Costeira; Giuseppe Amato. "Domain Adaptation for Vehicle Counting in Multiple Surveillance Cameras". Paper presented in Workshop in European Conference on Artificial Intelligence, 2020. Submitted Santiago, Carlos. "Video Analysis Based on Human Pose for Unsupervised Summarization and Retrieval". 2019. 10.1109/cbmi.2019.8877437 Medley, Daniela; Santiago, Carlos; Nascimento, Jacinto C.. "Segmenting the left ventricle in cardiac MRI: from handcrafted to deep region based descriptors". Paper presented in IEEE International Symposium on Biomedical Imaging (ISBI), Venice, 2019. Accepted Medley, Daniela O.; Santiago, Carlos; Nascimento, Jacinto C.. "Segmenting The Left Ventricle In Cardiac In Cardiac MRI: From Handcrafted To Deep Region Based Descriptors". 2019. Published • 10.1109/isbi.2019.8759179 Santiago, Carlos; Nascimento, Jacinto C.; Marques, Jorge S.. "Combining an Active Shape and Motion Models for Object Segmentation in Image Sequences". 2018. 10.1109/icip.2018.8451571 Santiago, C.; Nascimento, J.C.; Marques, J.S.; Santiago, Carlos; Nascimento, Jacinto C.; Marques, Jorge S.. "Fast and accurate segmentation of the LV in MR volumes using a deformable model with dynamic programming". 2018. 10.1109/ICIP.2017.8296581 Santiago, C.; Nascimento, J.C.; Marques, J.S.. "A new robust active shape model formulation for cardiac MRI segmentation". 2016. 10.1109/ICIP.2016.7533133 Santiago, C.; Nascimento, J.C.; Marques, J.S.. "Segmentation of the left ventricle in cardiac MRI using a probabilistic data association active shape model". 2015. 10.1109/EMBC.2015.7320078 Santiago, C.; Nascimento, J.C.; Marques, J.S.. "A robust active shape model using an expectation-maximization framework". 2014. 10.1109/ICIP.2014.7026226 Santiago, Carlos; Nascimento, Jacinto C.; Marques, Jorge S.; Santiago, C.; Nascimento, J.C.; Marques, J.S.. "Performance evaluation of point matching algorithms for left ventricle motion analysis in MRI". 2013. 10.1109/embc.2013.6610521 Santiago, C.; Marques, J.S.; Nascimento, J.C.. "A Robust Deformable Model for 3D Segmentation of the Left Ventricle from Ultrasound Data". 2013. 10.1007/978-1-4614-5076-4_11 Santiago, C.; Nascimento, J.C.; Marques, J.S.. "3D left ventricular segmentation in echocardiography using a probabilistic data association deformable model". 2013. 10.1109/ICIP.2013.6738125 Santiago, C.; Marques, J.S.; Nascimento, J.. "Robust deformable model for segmenting the left ventriclein 3D volumes of ultrasound data". 2012.
Conference poster	Lino, Filipa; Marques, Manuel; Santiago, Carlos. "3D Human Pose Estimation with Occlusions for Smart Stores". Paper presented in 2023 LARSyS Annual Meeting, 2023.
Journal article	Calisto, Francisco Maria; Abrantes, João Maria; Santiago, Carlos; Nunes, Nuno J.; Nascimento, Jacinto C.. "Personalized Explanations for Clinician-AI Interaction in Breast Imaging Diagnosis by Adapting Communication to Expertise Levels". International Journal of Human-Computer Studies 197 103444 (2025): 1-25. https://doi.org/10.1016/j.ijhcs.2025.103444. Published • 10.1016/j.ijhcs.2025.103444 Ciampi, Luca; Santiago, Carlos; Falchi, Fabrizio; Gennaro, Claudio; Amato, Giuseppe. "In the Wild Video Violence Detection: An Unsupervised Domain Adaptation Approach". SN Computer Science 5 7 (2024): https://doi.org/10.1007/s42979-024-03126-3. 10.1007/s42979-024-03126-3 Ciampi, Luca; Carrara, Fabio; Totaro, Valentino; Mazziotti, Raffaele; Lupori, Leonardo; Santiago, Carlos; Amato, Giuseppe; Pizzorusso, Tommaso; Gennaro, Claudio. "Learning to count biological structures with raters’ uncertainty". Medical Image Analysis 80 (2022): 102500. http://dx.doi.org/10.1016/j.media.2022.102500. 10.1016/j.media.2022.102500 Francisco Maria Calisto; Carlos Santiago; Nuno Nunes; Jacinto C. Nascimento. "BreastScreening-AI: Evaluating medical intelligent agents for human-AI interactions". Artificial Intelligence in Medicine (2022): https://doi.org/10.1016/j.artmed.2022.102285. 10.1016/j.artmed.2022.102285 Santiago, Carlos; Daniela O. Medley; Jorge dos Santos Salvador Marques; Jacinto C. Nascimento; Carlos Santiago; Jorge S. Marques. "Model-Agnostic Temporal Regularizer for Object Localization Using Motion Fields". IEEE Transactions on Image Processing 31 (2022): 2478-2487. https://doi.org/10.1109/TIP.2022.3155947. Accepted • 10.1109/TIP.2022.3155947 Medley, Daniela; Santiago, Carlos; Nascimento, Jacinto C.. "CyCoSeg: A Cyclic Collaborative Framework for Automated Medical Image Segmentation". IEEE Transactions on Pattern Analysis and Machine Intelligence (2021): 1-1. http://dx.doi.org/10.1109/tpami.2021.3113077. 10.1109/tpami.2021.3113077 Calisto, Francisco Maria; Santiago, Carlos; Nunes, Nuno; Nascimento, Jacinto C.. "Introduction of human-centric AI assistant to aid radiologists for multimodal breast image classification". International Journal of Human-Computer Studies 150 (2021): 102607. http://dx.doi.org/10.1016/j.ijhcs.2021.102607. 10.1016/j.ijhcs.2021.102607 Santiago, Carlos; Barata, Catarina; Sasdelli, Michele; Carneiro, Gustavo; Nascimento, Jacinto C.. "LOW: Training deep neural networks by learning optimal sample weights". Pattern Recognition (2020): 107585. http://dx.doi.org/10.1016/j.patcog.2020.107585. Published • 10.1016/j.patcog.2020.107585 Daniela O. Medley; Carlos Santiago; Jacinto C. Nascimento; Santiago, Carlos. "Deep Active Shape Model for Robust Object Fitting". IEEE Transactions on Image Processing 29 (2020): 2380-2394. https://doi.org/10.1109/TIP.2019.2948728. 10.1109/TIP.2019.2948728 Santiago, C.; Nascimento, J.C.; Marques, J.S.. "Fast segmentation of the left ventricle in cardiac MRI using dynamic programming". Computer Methods and Programs in Biomedicine 154 (2018): 9-23. http://www.scopus.com/inward/record.url?eid=2-s2.0-85033213787&partnerID=MN8TOARS. 10.1016/j.cmpb.2017.10.028 Santiago, C.; Nascimento, J.C.; Marques, J.S.. "A new ASM framework for left ventricle segmentation exploring slice variability in cardiac MRI volumes". Neural Computing and Applications 28 9 (2017): 2489-2500. http://www.scopus.com/inward/record.url?eid=2-s2.0-84968649830&partnerID=MN8TOARS. 10.1007/s00521-016-2337-1 Santiago, C.; Nascimento, J.C.; Marques, J.S.. "2D Segmentation Using a Robust Active Shape Model with the em Algorithm". IEEE Transactions on Image Processing 24 8 (2015): 2592-2601. http://www.scopus.com/inward/record.url?eid=2-s2.0-84938331289&partnerID=MN8TOARS. 10.1109/TIP.2015.2424311 Santiago, C.; Nascimento, J.C.; Marques, J.S.. "Automatic 3-D segmentation of endocardial border of the left ventricle from ultrasound images". IEEE Journal of Biomedical and Health Informatics 19 1 (2015): 339-348. http://www.scopus.com/inward/record.url?eid=2-s2.0-84920903514&partnerID=MN8TOARS. 10.1109/JBHI.2014.2308424
Thesis / Dissertation	Santiago, Carlos. "Segmentation of the Left Ventricle in Cardiac Magnetic Resonance". PhD, Universidade de Lisboa Instituto Superior Técnico, 2017. Santiago, Carlos. "ADJUSTMENT OF DEFORMABLE MODELS TO ORGAN SURFACES IN 3D IMAGES". Master, Universidade de Lisboa Instituto Superior Técnico, 2011.

Intellectual property

Patent	Francisco Maria Calisto; Santiago, Carlos; Duarte Nuno Jardim Nunes; Jacinto Carlos Nascimento. 2023. "Interactive Agents with an Assertiveness-based Communication Method and System for a Personalized Medicine on Breast Cancer Diagnosis". Portugal. Pending
Provisional application for patent	2023. "SISTEMA DE APRENDIZAGEM MÁQUINA PARA DIAGNÓSTICO DE LESÕES MAMÁRIAS ADAPTÁVEL AO CLÍNICO E BASEADO EM ASSERTIVIDADE". Disclosed

Other

Dataset

Lino, Filipa; Santiago, Carlos; Marques, Manuel. BlendMimic3D. 2024.

Activities

Oral presentation

	Presentation title	Event name Host (Event location)
2025/04/23	Prototype Learning: Designing Explainable Neural Networks	Seminar Universidad Autónoma de Madrid (Madrid, Spain)
2024/12/11	Artificial Intelligence: Key Concepts and Applications	Webinar: AI and Technology Applications in Landscape Ecology International Association for Landscape Ecology (IALE)-Europe (Portugal)
2024/11/21	Artificial Intelligence: Benefits and Dangers	Semana da Ciência e Tecnologia: Engenharia e Ciência Vão à Escola Colégio Bom Sucesso (Lisboa, Portugal)
2024/10/29	Role of AI in early breast cancer detection	1st International Conference on Young Women’s Breast Cancer and Health Breast Cancer Young Women (BCYW) Foundation (Portugal)
2024/10/17	Artificial Intelligence: Benefits and Dangers	Seminar Escola Damião de Goes (Alenquer, Portugal)
2017/09/20	FAST AND ACCURATE SEGMENTATION OF THE LV IN MR VOLUMES USING A DEFORMABLE MODEL WITH DYNAMIC PROGRAMMING	2017 IEEE International Conference on Image Processing (ICIP) IEEE
2015/08/27	SEGMENTATION OF THE LEFT VENTRICLE IN CARDIAC MRI USING A PROBABILISTIC DATA ASSOCIATION ACTIVE SHAPE MODEL	2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) IEEE
2015/06/18	ROBUST 3D ACTIVE SHAPE MODEL FOR THE SEGMENTATION OF THE LEFT VENTRICLE IN MRI	IbPRIA 2015: 7th Iberian Conference on Pattern Recognition and Image Analysis
2014/10/30	A robust active shape model using an expectation-maximization framework	2014 IEEE International Conference on Image Processing (ICIP) IEEE
2014/07/17	NON-RIGID OBJECT SEGMENTATION USING ROBUST ACTIVE SHAPE MODELS	International Conference on Articulated Motion and Deformable Objects 2014

Supervision

	Thesis Title Role	Degree Subject (Type) Institution / Organization
2025/09/01 - Current	Data Augmentation Techniques for Graph Data in Healthcare Co-supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/09/01 - Current	Eyetracking-based guided attention to model cycling perception of safety Co-supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/02/01 - Current	Recovering missing facial patches using text-conditioned generative models Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/02/01 - Current	Manipulation of urban landscapes with generative AI Co-supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/02/01 - Current	Multi-modal AI systems for personalized cancer treatment - Fusion of multiple modalities using Transformers Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/02/01 - Current	Explaining AI models for Medical Image Analysis Using Conformal Predictions Co-supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/02/01 - Current	Multi-modal AI systems for personalized cancer treatment - Contrastive Models and Generative AI to Handle Missing Data Co-supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/02/01 - Current	Semi-automatic segmentation tool for 3D medical images Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/02/01 - Current	Explaining AI models for tumor staging prediction using pathology images Co-supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/02/01 - Current	Assessing the impact of sex-specific life events on women's brain health Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2024/09/01 - Current	Region-Based Models for Robust Medical Image Analysis Supervisor	Engenharia Electrotécnica e de Computadores (PhD) Universidade de Lisboa Instituto Superior Técnico, Portugal
2024/09/01 - Current	Human Pose Estimation in Occluded Scenes from 2D Images Supervisor	Engenharia Electrotécnica e de Computadores (PhD) Universidade de Lisboa Instituto Superior Técnico, Portugal
2022/09/01 - Current	Fruit tracking and counting under multiple intermittent occlusions Co-supervisor	Engenharia Informática e de Computadores (PhD) Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/01/01 - 2023/12/01	Explainable Artificial Intelligence for Skin Cancer Detection: A Prototype-Based Deep Learning Architecture with Non-Expert Supervision Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/01/01 - 2023/12/01	Multi-modal approach for renal cancer prognosis with missing data Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/01/01 - 2023/12/01	Attention segmentation for medical imaging diagnosis Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/01/01 - 2023/12/01	Automatic Identification of Regions of Interest in Dermoscopy Images Using Vision Transformers and Weakly Supervised Learning Co-supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/01/01 - 2023/11/30	Hierarchical classification for diagnostics of breast cancer Supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/01/01 - 2023/11/30	3D pose estimation with occlusions for smart stores Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/01/01 - 2023/11/30	GAN Inversion for Occlusion Removal in Face Images Supervisor	Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/01/01 - 2023/11/20	Interactive Fashion Search and Recommendation Supervisor	Engenharia Informática e de Computadores Universidade de Lisboa Instituto Superior Técnico, Portugal
2022/02/01 - 2022/12/22	From clicks to conversations: generating clickstream-based dialogues in fashion e-commerce Supervisor	Mestrado em ciências de dados (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2021/09/01 - 2022/11/24	Session-Based Clothing Recommendation with Semantic and Aesthetic Information Supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2021/09/01 - 2022/11/15	Diagnosis and Detection of Breast Cancer using Deep Multiple Instance Learning Supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2018/09/19 - 2022/10/17	Automatic Segmentation of the Left Ventricle in Cardiac Magnetic Resonance using Deep Learning and Shape Statistics Co-supervisor	Engenharia Eletrotécnica e de Computadores (PhD) Universidade de Lisboa Instituto Superior Técnico, Portugal
2021/02/18 - 2022/06/23	Mimicking the Radiologists workflow in MRI Breast Classification Co-supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2020/01/01 - 2022/06/17	Machine learning for Breast screening diagnosis Supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2021/02/18 - 2021/11	Structured classification of fashion products with deep neural networks Supervisor	Engenharia e Ciência de Dados (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2020/09/01 - 2021/11	Automatic diagnosis of breast cancer with deep neural networks in multimodal images Co-supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2020/09/01 - 2021/11	Weakly supervised classification and segmentation of breast lesions Supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2019/02/01 - 2021/11	Density-based Traffic Counting using Deep Neural Networks Co-supervisor	Engenharia Eletrotécnica e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2018/10/01 - 2021/01/13	Breast Cancer Detection in Multiview Mammography with Deep Learning Co-supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2018/02/01 - 2019/06/28	Fish Detection in Image Sequences Co-supervisor	Engenharia Eletrotécnica e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2018/02/27 - 2019/05/30	Análise comportamental de peixes em caudais de rios Co-supervisor	Engenharia Informática e de Computadores (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2018/02/01 - 2018/11/21	Deep learning of dynamic functional connectivity states during sleep and epilepsy using simultaneous EEG-fMRI Co-supervisor	Engenharia Biomédica (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal

Event organisation

	Event name Type of event (Role)	Institution / Organization
2021/10/20 - 2021/10/20	ACM Multimedia 2021 Workshop on Multimodal Conversational AI (2021/10/20 - 2021/10/24) Workshop (Co-organisor)

Event participation

	Activity description Type of event	Event name Institution / Organization
2018/09/13 - 2018/09/14	6th MultiDrone Consortium Meeting, Lisbon Meeting	6th MultiDrone Consortium Meeting, Lisbon Laboratório de Robótica e Sistemas de Engenharia, Portugal
2018/06/14 - 2018/06/15	LARSyS Annual Meeting Meeting	LARSyS Annual Meeting Laboratório de Robótica e Sistemas de Engenharia, Portugal
2018/06/04 - 2018/06/05	5th MultiDrone Consortium Meeting, Turin Meeting	5th MultiDrone Consortium Meeting, Turin Radiotelevisione Italiana, Italy
2018/03/22 - 2018/03/23	SPARSIS project workshop with invited consultants: Prof. Vittorio Murino and Prof. Andrea Cavallaro Workshop	SPARSIS project workshop Laboratório de Robótica e Sistemas de Engenharia, Portugal
2017/05/18 - 2017/05/19	SPARSIS project workshop: visit from consultant Prof. Mario Sznaier and Prof. Octavia I. Camps Workshop	SPARSIS project workshop Laboratório de Robótica e Sistemas de Engenharia, Portugal
2016/10/28 - 2016/10/28	22th edition of the Portuguese Conference On Pattern Recognition Conference	22th edition of the Portuguese Conference On Pattern Recognition Associação Portuguesa de Reconhecimento de Padrões, Portugal
2016/07/04 - 2016/07/06	Encontro com a Ciência e Tecnologia em Portugal Meeting	Ciência 2016 Fundação para a Ciência e a Tecnologia, Portugal
2015/07/03 - 2015/07/04	LARSyS Annual Meeting Meeting	LARSyS Annual Meeting Laboratório de Robótica e Sistemas de Engenharia, Portugal
2013/07/04 - 2013/07/05	LARSyS Annual Meeting Meeting	LARSyS Annual Meeting Laboratório de Robótica e Sistemas de Engenharia, Portugal
2011/10/28 - 2011/10/28	17th edition of the Portuguese Conference on Pattern Recognition Conference	17th edition of the Portuguese Conference on Pattern Recognition Associação Portuguesa de Reconhecimento de Padrões, Portugal

Jury of academic degree

	Topic Role	Candidate name (Type of degree) Institution / Organization
2024/11/23	Vision Transformer for the segmentation of 3D microscopy images (Thesis) Main arguer	Gonçalo da Silva Dias Moura de Mesquita (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2024/11/16	Personality Prediction through Low-Complexity Classification Models (Thesis) Main arguer	Pedro Miguel Carvalho Jacinto (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2024/11/15	Impact of Free-Viewing Search on Transformer-Based Goal-Directed Search (Thesis) Main arguer	Gabriel Duarte Marques (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2024/11/04	Combining Deep Learning and Optimization for MEMS Devices Design (Thesis) Main arguer	Luís Filipe Martins Tripa (Master) Universidade NOVA de Lisboa Faculdade de Ciências e Tecnologia, Portugal
2024/11/02	Automatic segmentation of outer retinal layers with deep learning in ophtalmology (Thesis) Main arguer	João Duarte do Nascimento Dias Afonso (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2024/11/01	Discovering Patterns in Breast Cancer Patients’ Data (Thesis) Main arguer	Sofia Filipa Saraiva Rebola (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2024/07/25	Advancements in Image Processing: Bridging Variational Approaches and Mathematical Morphology for Efficient Optimization Solutions (Thesis) Main arguer	Miguel Faria Amorim (Master) Universidade do Porto Faculdade de Engenharia, Portugal
2024/05/31	Enhancing Underwater Object Detection, Multi-Label Classification, and Out-of-Distribution Detection with Advanced Deep Learning Techniques and Augmentation Methods (Thesis) Main arguer	Md Sazidur Rahman (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2024/03/21	Multimodal Cervical Cancer Diagnosis: Deep Learning for Automatic Decision Support (Thesis) Arguer	Tomé Mendes Albuquerque (PhD) Universidade do Porto Faculdade de Engenharia, Portugal
2024/02/27	Contrastive Learning for Medical Imaging (Thesis) Main arguer	Hugo Miguel Pereira Figueiras (Master) Universidade de Lisboa Faculdade de Ciências, Portugal
2023/12/21	Transferring Visual Attributes from Natural Language to Verified Image Generation (Thesis) Main arguer	Rodrigo João Cruz Valério (Master) Universidade NOVA de Lisboa Faculdade de Ciências e Tecnologia, Portugal
2023/11/28	Artificial Intelligence Framework for Human-Robot Cooperative Operation through Dynamic Hand Gestures (Thesis) Main arguer	Luis Alejandro Grajeda Blandon (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/11/28	Post-Stroke Gait Rehabilitation Assistive System (Thesis) Main arguer	João Paulo de Abrantes Raio e Lucas Lavrador (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/07/06	Monitorização de ensaios dinâmicos através de sistemas de visão (Thesis) Main arguer	Marco Tiago Araújo Brandão (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2023/06/16	Developing and Integrating Deep Learning Computer Vision Algorithms for Augmented Reality Assistance in SATCOM Assembly, Integration and Test (Thesis) Main arguer	Gonçalo Ferreira Balão Silva (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2022/12/02	Learning to search for and detect objects in foveal images using deep learning (Thesis) Main arguer	Beatriz de Andrade Milheiro Ribeiro Paula (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2022/11/25	Pan-Tilt-Zoom Imaging Storage and Retrieval using Wavelets (Thesis) Main arguer	João Manuel Reis dos Santos Silva (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2022/11/23	Automatic OCT based retinal blood vessel classification (Thesis) Main arguer	Daniel Filipe da Encarnação Galhoz (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2022/11/22	Unsupervised Segmentation of Fluorescent Microscopy Images Using CycleGAN (Thesis) Main arguer	Alice Henriques da Rosa (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2022/11/07	Conversational Interactive Recommendation (Thesis) Main arguer	Alexandre Teixeira Lobato Correia (Master) Universidade NOVA de Lisboa Faculdade de Ciências e Tecnologia, Portugal
2022/06/28	Learning to search for objects in foveal images using deep learning (Thesis) Main arguer	Beatriz Pereira Horta Cabarrão (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2021/10	Reconhecimento Facial Multiespectral em Ambiente Não Controlado (Thesis) Main arguer	Pedro Afonso Roque Martins (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2021/10	Using Multi-Input Deep Learning Networks in Medical Images for the Automatic Detection of Pathological States (Thesis) Main arguer	Beatriz De Oliveira Noronha Filipe (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2021/03/05	Deep Learning Tools for Outcome Prediction in Atrial Fibrillation from Cardiac MRI (Thesis) Main arguer	Ana Catarina Feliciano Lourenço (Master) Fundação da Faculdade de Ciências da Universidade de Lisboa, Portugal
2020/09/18	Joint segmentation and diagnosis of skin lesions (Thesis) Main arguer	Francisco Castelbranco da Silveira de Sena Esteves (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2019/11/25	Identification of EEG Fingerprints of Simultaneous fMRI in Resting State and Motor Imagery (Thesis) Main arguer	Marta Antunes Evangelista Loures Xavier (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal
2019/06/27	Speech Recognition for a Small Aerial Robot (Thesis) Main arguer	Ana Catarina Monteiro Ribeiro de Sá (Master) Universidade de Lisboa Instituto Superior Técnico, Portugal

Course / Discipline taught

	Academic session	Degree Subject (Type)	Institution / Organization
2021/11/29 - 2026/01/31	Image Processing and Vision	Engenharia Electrotécnica e de Computadores (Mestrado)	Universidade de Lisboa Instituto Superior Técnico, Portugal
2025/01/08 - 2025/01/16	Inteligência Artificial e Machine Learning em Transportes	Mobilidade 360: Pós-Graduação em Gestão de Transportes (Pós-Graduação)	ISCTE-Instituto Universitário de Lisboa, Portugal
2024/04/15 - 2024/05/31	Processing Big Data	Engenharia Electrotécnica e de Computadores (Mestrado)	Universidade de Lisboa Instituto Superior Técnico, Portugal
2020/09/01 - 2021/02/18	Signals and Systems	Engenharia Electrotécnica e de Computadores (Licenciatura)	Universidade de Lisboa Instituto Superior Técnico, Portugal
2018/03/07 - 2018/03/07	Workshop on Deep Learning Frameworks	(Outros)	Laboratório de Robótica e Sistemas de Engenharia, Portugal

Evaluation committee

	Activity description Role	Institution / Organization	Funding entity
2020/09/01 - 2020/10/31	Evaluation of project applications for ANI	Agência Nacional de Inovação SA, Portugal

Journal scientific committee

	Journal title (ISSN)	Publisher
2020/10/01 - 2021/07/31	Sensors - Special Issue in Image Sensing Detection in Bio-Systems Using Convolutional Neural Networks (1424-8220)	MDPI

Mentoring / Tutoring

	Topic	Student name
2021/05/01 - Current	Segmentation of Myocardial Ischemic Lesions in Cardiac MRI	Marc Golub
2020/01/05 - 2020/03/07	Domain Adaptation for Vehicle Counting in Multiple Surveillance Cameras	Luca Ciampi

Distinctions

Award

2023	Best Paper Award, 3rd International Conference on Image Processing and Vision Engineering (IMPROVE) 2023
2023	Honorable Mention Award, 8th ISIC Skin Image Analysis Workshop@MICCAI 2023
2020	Honorable Mention Award, 5th ISIC Skin Image Analysis Workshop@CVPR 2020 International Skin Image Collaboration, United States
2018	NVIDIA GPU Grant NVIDIA Corp, United States
2015	Best Paper Award, IbPRIA 2015 Associação Portuguesa de Reconhecimento de Padrões, Portugal