- Home
- Faculty & Staff
- Core Faculty & Staff
- Spyridon Bakas, Ph.D.
- FeTS
The Federated Tumor Segmentation (FeTS) initiative
The Federated Tumor Segmentation (FeTS) initiative, describes the on-going development of i) the largest international federation of healthcare institutions, and ii) an open-source toolkit with a user-friendly GUI, aiming at gaining knowledge for tumor boundary detection from ample and diverse patient populations without sharing any patient data.
The FeTS toolkit focuses on:
- bringing pre- trained segmentation models of numerous deep learning algorithms and their fusion, closer to clinical experts and researchers, thereby enabling easy quantification of new radiographic scans and comparative evaluation of new algorithms.
- allowing secure multi- institutional collaborations via federated learning to improve these pre-trained models without sharing patient data, thereby overcoming legal, privacy, and data-ownership challenges.
Successful completion of this project will lead to an easy-to-use potentially-translatable tool enabling easy, fast, objective, repeatable and accurate tumor segmentation, without requiring a computational background by the user, and while facilitating further analysis of tumor radio-phenotypes towards accelerating discovery.
FeTS Collaborating Sites
This is the list of institutions that took part in the first large-scale federation study [ref].
Flinders University |
Bedford Park |
South Australia |
Australia |
Neuromed Campus |
Kepler University Hospital Linz |
Linz |
Austria |
Instituto de Neurologia de Curitiba |
Curitiba |
Paraná |
Brazil |
Universidade Federal do Paraná |
Curitiba |
Paraná |
Brazil |
University of Campinas |
Campinas |
São Paulo |
Brazil |
Federal Institute of Education Science and Technology of São Paulo |
Araraquara |
São Paulo |
Brazil |
Hospital de Clínicas da Universidade Federal do Paraná |
Curitiba |
Paraná |
Brazil |
University of Alberta |
Edmonton |
Alberta |
Canada |
Université de Sherbooke |
Sherbrooke |
Quebec |
Canada |
Queens University |
Kingston |
Ontario |
Canada |
Universidad de Concepción |
Concepción |
Bío Bío |
Chile |
The Chinese University of Hong Kong |
Hong Kong |
Hong Kong |
China |
Clínica Imbanaco Quirón Salud |
Cali |
Valle del Cauca |
Colombia |
Universidad del Valle |
Cali |
Valle del Cauca |
Colombia |
Faculty of Informatics - Masaryk University |
Brno |
South Moravian |
Czech Republic |
Escuela Superior Politecnica del Litoral |
Guayaquil |
Guayas |
Ecuador |
University of Cairo School of Medicine |
Giza |
Giza |
Egypt |
Klinikum rechts der Isar |
Munich |
Bavaria |
Germany |
Technical University of Munich |
Munich |
Bavaria |
Germany |
Heidelberg University Hospital |
Heidelberg |
Baden-Württemberg |
Germany |
University of Patras |
Patras |
Western Greece |
Greece |
Symbiosis International University |
Pune |
Maharashtra |
India |
National Institute of Mental Health and Neurosciences |
Bengaluru |
Karnataka |
India |
Tata Memorial Centre |
Mumbai |
Maharashtra |
India |
Shri Guru Gobind Singhji Institute of Engineering and Technology |
Nanded |
Maharashtra |
India |
Yonsei University College of Medicine |
Seoul |
Seoul |
Korea |
Asan Medical Center |
Seoul |
Seoul |
South Korea |
Luxembourg Institute of Health |
Luxembourg |
Luxembourg |
Luxembourg |
Erasmus MC University Medical Centre Rotterdam |
Rotterdam |
South Holland |
Netherlands |
Netherlands Cancer Institute |
Amsterdam |
North Holland |
Netherlands |
University College Hospital Ibadan |
Ibadan |
Oyo |
Nigeria |
Clinix Healthcare |
Lagos |
Lagos |
Nigeria |
Muhammad Abdullahi Wase Teaching Hospital |
Kano |
Kano |
Nigeria |
Obafemi Awolowo University Ile-Ife |
Ile-Ife |
Osun |
Nigeria |
Catalan Institute of Oncology |
Badalona |
Catalonia |
Spain |
Parc Sanitari Pere Virgili |
Barcelona |
Catalonia |
Spain |
Institute of Diagnostic Imaging (IDI) - Research Unit (IDIR) - Parc Sanitari Pere Virgili |
Barcelona |
Catalonia |
Spain |
University of Bern |
Bern |
Bern |
Switzerland |
University of Zurich |
Zurich |
Zurich |
Switzerland |
The University of Edinburgh |
Edinburgh |
Scotland |
United Kingdom |
University of Birmingham |
Birmingham |
Britain |
United Kingdom |
Imperial College London |
London |
Britain |
United Kingdom |
Queen Mary University of London |
London |
Britain |
United Kingdom |
University of Leeds |
Leeds |
Britain |
United Kingdom |
King's College Hospital |
London |
Britain |
United Kingdom |
Massachusetts General Hospital |
Charlestown |
Massachusetts |
USA |
University of California Los Angeles |
Los Angeles |
California |
USA |
University of Texas Southwestern Medical Center |
Dallas |
Texas |
USA |
New York University |
New York |
New York |
USA |
Case Western Reserve University |
Cleveland |
Ohio |
USA |
Georgetown University |
Washington |
District of Columbia |
USA |
Neosoma Incorporated |
Groton |
Massachusetts |
USA |
University of Pittsburgh |
Pittsburgh |
Pennsylvania |
USA |
University of Texas MD Anderson Cancer Center |
Houston |
Texas |
USA |
University of Washington |
Seattle |
Washington |
USA |
University of Alabama in Birmingham |
Birmingham |
Alabama |
USA |
Washington University in St. Louis |
St. Louis |
Missouri |
USA |
Vanderbilt University |
Nashville |
Tennessee |
USA |
University of Michigan |
Ann Arbor |
Michigan |
USA |
Johns Hopkins University School of Medicine |
Baltimore |
Maryland |
USA |
University of Wisconsin Madison School of Medicine and Public Health |
Madison |
Wisconsin |
USA |
Icahn School of Medicine at Mount Sinai |
New York |
New York |
USA |
University of Iowa |
Iowa City |
Iowa |
USA |
Stony Brook University |
Stony Brook |
New York |
USA |
Oak Ridge National Laboratory |
Oak Ridge |
Tennessee |
USA |
Henry Ford Health System |
Detroit |
Michigan |
USA |
Baylor College of Medicine |
Houston |
Texas |
USA |
University Hospitals Cleveland |
Cleveland |
Ohio |
USA |
Case Western Reserve University |
Cleveland |
Ohio |
USA |
University of Pennsylvania |
Philadelphia |
Pennsylvania |
USA |
Thomas Jefferson University |
Philadelphia |
Pennsylvania |
USA |
Christiana Care Health System |
Philadelphia |
Pennsylvania |
USA |
University of Maryland |
Baltimore |
Maryland |
USA |
James Cancer Center - The Ohio State University |
Columbus |
Ohio |
USA |
University of Colorado |
Boulder |
Colorado |
USA |
H. Lee Moffitt Cancer Center and Research Institute |
Tampa |
Florida |
USA |
American College of Radiology |
Reston |
Virginia |
USA |
Brigham and Women's Hospital - Harvard Medical School |
Boston |
Massachusetts |
USA |
Intel Corporation |
Santa Clara |
California |
USA |
- S Pati, U Baid, B Edwards, MJ Sheller, …, S Bakas, " Federated Learning Enables Big Data for Rare Cancer Boundary Detection", Nature Communications 13(1), 1-17, 2022. DOI: http://www.doi.org/10.1038/s41467-022-33407-5
- Available on: PubMed, Publisher (Nature.com)
- U Baid, S Pati, TM Kurc, R Gupta, E Bremer, S Abousamra, SP Thakur, JH Saltz, S Bakas, " Federated Learning for the Classification of Tumor Infiltrating Lymphocytes", preprint arXiv:2203.16622.
- Available on: arXiv (preprint)
- MJ Sheller, B Edwards, GA Reina, J Martin, S Pati, A Kotrotsou, M Milchenko, W Xu, D Marcus, RR Colen, S Bakas, "Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data", Scientific Reports, 10(1):1-12, 2020.
- DOI: https://doi.org/10.1038/s41598-020-69250-1
- Available on: PubMed, NCBI, Publisher (Nature.com)
- MJ Sheller, GA Reina, B Edwards, J Martin, S Bakas, "Multi-Institutional Deep Learning Modeling Without Sharing Patient Data: A Feasibility Study on Brain Tumor Segmentation", MICCAI Brainlesion — Springer LNCS, 11383:92-104, 2018.
- DOI: https://doi.org/10.1007/978-3-030-11723-8_9
- Available on: PubMed, Publisher (Springer), arXiv (preprint)
- A. Karargyris, R. Umeton, M. J. Sheller, A. Aristizabal, J. George, A. Wuest, S. Pati, H. Kassem, U. Baid, P. N. Moorthy, A. Chowdhury, J. Guo, S. Nalawade, J. Rosenthal, D. Kanter, M. Xenochristou, D. J. Beutel, V. Chung, T. Bergquist, J. Eddy, A. Abid, L. Tunstall, O. Sanseviero, D. Dimitriadis, Y. Qian, X. Xu, Y. Liu, S. Bala, V. Bittorf, A. Chaudhari, C. Coleman, B. Desinghu, G. Diamos, D. Dutta, D. Feddema, G. Fursin, X. Huang, S. Kashyap, N. Lane, I. Mallick, FeTS Consortium, BraTS-2020 Consortium, AI4SafeChole Consortium, CHAOS Consortium, P. Mascagni, V. Mehta, C. F. Moraes, V. Natarajan, N. Nikolov, N. Padoy, G. Pekhimenko, V. J. Reddi, G. A. Reina, P. Ribalta, A. Singh, J. J. Thiagarajan, J. Albrecht, T. Wolf, G. Miller, H. Fu, D. Xu, P. Yadav, M. Rosenthal, L. Marchionni, M. Loda, J. M. Johnson, S. Bakas, P. Mattson. MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluation. Under Review, 2023
Abstracts
- U Baid, S Pati, S Thakur, B Edwards, M Sheller, J Martin, S Bakas, “NIMG-32. The Federated Tumor Segmentation (FeTS) Initiative: The First Real-World Large-Scale Data-Private Collaboration Focusing on Neuro-Oncology”, Neuro-Oncology, Volume 23, Issue Supplement_6, November 2021, Pages vi135–vi136, https://doi.org/10.1093/neuonc/noab196.532
- MJ Sheller, GA Reina, B Edwards, J Martin, S Bakas, "Federated Learning In Neuro-Oncology For Multi-Institutional Collaborations Without Sharing Patient Data", Neuro-Oncology, Volume 21, Issue 6, Pages vi176–vi177, 2019.
- DOI: https://doi.org/10.1093/neuonc/noz175.737
- Available on: Publisher (Oxford University Press)
Past:
- RSNA 2021
- SNO 2021
- ICLR 2021 (May 4-8)
- 2020 MED-NeurIPS 2020 - virtual due to COVID-19
- 2020 SC'20 (Nov 9-19) - Virtual due to COVID-19
Live demo - 2019 SNO (Nov. 21-24) - Arizona, USA
Oral Presentation (slides)
@ the 24th Annual Scientific Meeting of the Society for Neuro-Oncology - 2019 AACR (date) - place, USA.
Oral Presentation
@ the American Association for Cancer Research - 2018 ECOG-ACRIN (Oct.24-26) - Fort Lauderdale, USA
Oral Presentation - 2018 MICCAI (Sep.16-20) - Granada Conference Center, Granada, Spain
Oral Presentation
@ the Medical Image Computing and Computer Assisted Intervention conference
The FeTS Tool, and consensus model produced during the largest FL study [ref], can be found in https://github.com/FETS-AI/Front-End
Linux binaries are available from https://www.nitrc.org/frs/downloadlink.php/13219
It uses OpenFL under the hood for constructing and managing the federation, and that can be found in https://github.com/intel/openfl
The data science algorithm is defined using GaNDLF, and that can be found in https://github.com/mlcommons/GaNDLF
Press Release:
- 2022.05.11: (Intel Newsroom)
- 2020.10.14: (American College of Radiology - ACR)
- 2020.07.26: (Penn Medicine News)
- 2020.05.11: (Intel's News Byte)
Media coverage:
-
IT-Online: Intel talks trust at Intel Vision
-
Gadget: Intel launched cloud trust service
- Pipeline Pub: Intel Introduces Cloud-to-Edge and On-Premises Trust Assurance
- ITechnology: Intel Introduces Project Amber for Cloud-to-Edge and On-Premises Trust Assurance
- BusinessWire: Intel Introduces Project Amber for Cloud-to-Edge and On-Premises Trust Assurance
- Chip.com: "Turkish Technology News Website"
- HWUpgrade.it: "Italian Technology News Website"
- Investor.id: "Indonesian Technology News Website"
-
Science Journal: Catching cancer extremely early
- AI Business: Intel and UPenn to use federated AI for privacy-preserving brain tumor research
- AI in Healthcarecare: Federated machine learning to take on brain-tumor diagnosis
- All About Circuits: Is Machine Learning for Tumor Research at Odds With Patient Privacy? Not With Federated Learning, Intel Says
- Becker's Hospital Review: Penn Medicine, Intel collaborate on AI to identify brain tumors
- BioWorld: Other news to note for May 11, 2020
- Brink Wire: Intel and Penn Medicine Partnering to Develop an A.I. That Can Discover Brain Tumors
- Built In: Federated Learning Fuses Ai And Privacy — And It Could Transform Healthcare
- BusinessWire: Intel Works with University of Pennsylvania in Using Privacy-Preserving AI to Identify Brain Tumors
- CB Insights: This Week In AI: Waymo Raises $750M, Facebook Applies AI To Clinical Trials, Facial Recognition Startup Cloudwalk Raises $254M
- Click Lancashire Independent News: Intel and University of Pennsylvania are using AI to find brain tumors
- Digital Trends: Intel and University of Pennsylvania are using A.I. to find brain tumors
- Syndication: Hypothermia, Yahoo! Finance, News Break
- Digital Trends Live: Apple iPhone 12 Leaks + An All Digital Comic-Con | Digital Trends Live 5.11.20
- Engadget: Intel and Penn Medicine are developing an AI to spot brain tumors
- Syndication: 1010.team, Flipboard, MSN, Tech Investor News, OneNewsPage
- Enterprise Talk: Intel and UPenn Partner with 29 Health Organizations to Train AI Models
- Explica: Artificial intelligence could detect brain tumors
- FierceElectronics: Intel and UPenn head group using AI to find brain tumor
- Grvn
- Healthcare IT News: Penn Medicine, Intel developing new AI approach to detecting brain tumors
- HealthIT Analytics: UPenn, Intel Partner to Use Machine Learning to Detect Brain Tumors
- HIT Consultant: Intel, UPenn Form AI Initiative to Identify Brain Tumors via Secure Data
- HPCwire
- iGamesNews
- InfoTechLead: Intel and Penn Medicine use AI to identify brain tumors
- InsideHPC
- Investor Ideas Podcast: The AI Eye Episode 247: Intel Labs (NasdaqGS: $INTC) Working with Penn Medicine on Development of AI Models for Brain Tumor Identification, IBM (NYSE: $IBM) Announces Vodafone Idea Ltd. (NSE: $IDEA) Achieves Milestone on Open Universal Hybrid Cloud
- Journal of Cyber Policy: Intel Works With University Of Pennsylvania In Using Privacy-Preserving Ai To Identify Brain Tumors
- Kaiser Health News: When Sharing Research Data Is Rare, This Novel Approach On Mapping Brain Tumors Brings Together 30 Centers
- MarketWatch: The AI Eye Episode 247: Intel Labs Working with Penn Medicine on Development of AI Models for Brain Tumor Identification, IBM Announces Vodafone Idea Ltd. Achieves Milestone on Open Universal Hybrid Cloud
- MedCity News: UPenn, Intel partner to use federated learning AI for early brain tumor detection
- Mike Raves Wordpress: Intel and Penn Medicine are developing an AI to spot brain tumors
- MobiHealthNews: Welltok adds four new digital programs, Atrium Health adopts Butterfly's handheld ultrasound and more digital health deals
- Seeking Alpha: Intel looking to improve tumor detection
- SlashGear: This AI is learning to spot brain tumors – without infringing privacy
- Somagnews
- STAT News: Hospitals are reluctant to share data. A new effort to map brain tumors with AI is getting their help another way
- stateOfPress
- TechTimes: Intel and Penn Medicine Partnering to Develop an A.I. That Can Discover Brain Tumors
- TheBest.gr (Interview in Greek): Researcher from Patras (Greece) leads a collaboration of 30 institutions to a novel model for cancer detection
- The Breaking News Headlines
- The Burn In: Intel using AI to identify brain tumors and protect privacy
- Wall Street Journal Pro AI: Intel, Health Institutions to Use Emerging AI Technique to Improve Tumor Detection
- Yahoo Finance
- VentureBeat: Intel partners with Penn Medicine to develop brain tumor classifier with federated learning
- Syndication: News Break, Pioneering Minds, Tech Investor News, World News Monitor, 15 Minute News
- Unite.ai
- Welcome AI: Federated Learning for Medical Imaging
- World-Today-News: This AI detects brain tumors while respecting data confidentiality
- ZDNet: Intel, UPenn partner with 29 health organizations to train AI to spot brain tumors
- Geekzilla: Intel collaborates with AI to identify brain tumors
- Mobile Syrup: Intel, Penn Medicine to co-develop AI tool for identifying brain tumours
- Olhar Digital: Research centers want to teach AI to identify brain tumors
- Technocio: Intel collaborates with the University of Pennsylvania in the use of intelligence to identify brain tumors
- Tecnogaming: Federal learning preserves patient data to identify brain tumors
- Ciber Sur: Intel and University of Pennsylvania to Use Privacy-Protective AI to Identify Brain Tumors
- CorCom: Brain tumor, AI and machine learning for early diagnosis
- Fanáticos Hardware: Intel works with the University of Pennsylvania on the use of Artificial Intelligence to identify brain tumors
- Fudzilla: Intel sets its AI onto brain tumours
- Hats New: Intel will work on artificial intelligence specialized in detecting brain tumors
- KultureGeek: Intel's working on an AI to detect brain tumors –
- La Gazette du Laboratoire : Intel collaborates with the University of Pennsylvania in the use of AI to identify brain tumors while preserving privacy
- L’Usine Digitale: This artificial intelligence detects brain tumours while preserving the confidentiality of the data
- Muy Computer Pro: Intel to Develop Artificial Intelligence to detect brain tumors
- Presse Citron: This AI detects brain tumours while respecting the confidentiality of the data
- Punto Informatico: From Intel an AI against brain tumor
- TechPrincess: Intel and Penn Medicine will develop a brain tumor classifier through federated learning
- Tecnelab: Intel and the University of Pennsylvania use AI to identify brain tumors
- Techeconomy: Artificial intelligence to identify brain tumors
- Businessworld: Intel Works with the University of Pennsylvania in Using Privacy-Preserving AI to Identify Brain Tumors
- Cell IT: Intel Works with University of Pennsylvania in Using Privacy-Preserving AI to Identify Brain Tumors
- Financial Express: AI to speed brain tumour diagnosis
- Gadgets Now: Intel to develop technology to train AI help identify brain tumors
- Indiatimes: AI effort to detect brain tumor early and save over 80,000 lives launched worldwide
- The Medical AI Times: AI privacy protection to spot brain tumors – Federated learning from Intel and University of Pennsylvania
- The Times of India: Intel to develop technology to train AI help identify brain tumors
- VAR India: Intel with University of Pennsylvania enables Privacy-Preserving AI to identify brain tumors
- ZDNet Japan: Intel, UPenn partner with 29 health organizations to train AI to spot brain tumors
Advisors
- Bakas, Spyridon (Principal Investigator)
- Davatzikos, Christos
- Kontos, Despina
- Martin, Jason (Intel Labs)
- Menze, Bjoern (TUM)
Contributors (alphabetical order):
- Baid, Ujjwal
- Bergman, Mark
- Bhalerao, Megh
- Edwards, Brandon (Intel Labs)
- Pati, Sarthak (Lead Developer - UPenn)
- Reina, G Anthony (Intel AI)
- Sheller, Micah (Lead Developer - Intel Labs)
- Thakur, Siddhesh P.
- Wang, Shih-han “Hans” (Intel Labs)
- Xu, Weilin (Intel Labs)
Supporting Grant: This work is partly funded through the NIH/NCI/ITCR-supported grant U01CA242871.
Disclaimer: The software is designed for research purposes and is neither FDA-approved, nor CE-marked.
Contact CBICA Software for questions, etc.