The Federated Tumor Segmentation (FeTS) initiative

The Federated Tumor Segmentation (FeTS) initiative, describes the on-going development of i) the largest international federation of healthcare institutions, and ii) an open-source toolkit with a user-friendly GUI, aiming at gaining knowledge for tumor boundary detection from ample and diverse patient populations without sharing any patient data.

The FeTS toolkit focuses on:

  1. bringing pre- trained segmentation models of numerous deep learning algorithms and their fusion, closer to clinical experts and researchers, thereby enabling easy quantification of new radiographic scans and comparative evaluation of new algorithms. 
  2. allowing secure multi- institutional collaborations via federated learning to improve these pre-trained models without sharing patient data, thereby overcoming legal, privacy, and data-ownership challenges.

Successful completion of this project will lead to an easy-to-use potentially-translatable tool enabling easy, fast, objective, repeatable and accurate tumor segmentation, without requiring a computational background by the user, and while facilitating further analysis of tumor radio-phenotypes towards accelerating discovery. 

FeTS Collaborating Sites

fets map

This is the list of institutions that took part in the first large-scale federation study [ref].

Flinders University

 Bedford Park

 South Australia

 Australia

Neuromed Campus

 Kepler University Hospital Linz

 Linz

 Austria

Instituto de Neurologia de Curitiba

 Curitiba

 Paraná

 Brazil

Universidade Federal do Paraná

 Curitiba

 Paraná

 Brazil

University of Campinas

 Campinas

 São Paulo

 Brazil

Federal Institute of Education Science and Technology of São Paulo

 Araraquara

 São Paulo

 Brazil

Hospital de Clínicas da Universidade Federal do Paraná

 Curitiba

 Paraná

 Brazil

University of Alberta

 Edmonton

 Alberta

 Canada

Université de Sherbooke

 Sherbrooke

 Quebec

 Canada

Queens University

 Kingston

 Ontario

 Canada

Universidad de Concepción

 Concepción

 Bío Bío

 Chile

The Chinese University of Hong Kong

 Hong Kong

 Hong Kong

 China

Clínica Imbanaco Quirón Salud

 Cali

 Valle del Cauca

 Colombia

Universidad del Valle

 Cali

 Valle del Cauca

 Colombia

Faculty of Informatics - Masaryk University

 Brno

 South Moravian

 Czech Republic

Escuela Superior Politecnica del Litoral

 Guayaquil

 Guayas

 Ecuador

University of Cairo School of Medicine

 Giza

 Giza

 Egypt

Klinikum rechts der Isar

 Munich

 Bavaria

 Germany

Technical University of Munich

 Munich

 Bavaria

 Germany

Heidelberg University Hospital

 Heidelberg

 Baden-Württemberg

 Germany

University of Patras

 Patras

 Western Greece

 Greece

Symbiosis International University

 Pune

 Maharashtra

 India

National Institute of Mental Health and Neurosciences

 Bengaluru

 Karnataka

 India

Tata Memorial Centre

 Mumbai

 Maharashtra

 India

Shri Guru Gobind Singhji Institute of Engineering and Technology

 Nanded

 Maharashtra

 India

Yonsei University College of Medicine

 Seoul

 Seoul

 Korea

Asan Medical Center

 Seoul

 Seoul

 South Korea

Luxembourg Institute of Health

 Luxembourg

 Luxembourg

 Luxembourg

Erasmus MC University Medical Centre Rotterdam

 Rotterdam

 South Holland

 Netherlands

Netherlands Cancer Institute

 Amsterdam

 North Holland

 Netherlands

University College Hospital Ibadan

 Ibadan

 Oyo

 Nigeria

Clinix Healthcare

 Lagos

 Lagos

 Nigeria

Muhammad Abdullahi Wase Teaching Hospital

 Kano

 Kano

 Nigeria

Obafemi Awolowo University Ile-Ife

 Ile-Ife

 Osun

 Nigeria

Catalan Institute of Oncology

 Badalona

 Catalonia

 Spain

Parc Sanitari Pere Virgili

 Barcelona

 Catalonia

 Spain

Institute of Diagnostic Imaging (IDI) - Research Unit (IDIR) - Parc Sanitari Pere Virgili

 Barcelona

 Catalonia

 Spain

University of Bern

 Bern

 Bern

 Switzerland

University of Zurich

 Zurich

 Zurich

 Switzerland

The University of Edinburgh

 Edinburgh

 Scotland

 United Kingdom

University of Birmingham

 Birmingham

 Britain

 United Kingdom

Imperial College London

 London

 Britain

 United Kingdom

Queen Mary University of London

 London

 Britain

 United Kingdom

University of Leeds

 Leeds

 Britain

 United Kingdom

King's College Hospital

 London

 Britain

 United Kingdom

Massachusetts General Hospital

 Charlestown

 Massachusetts

 USA

University of California Los Angeles

 Los Angeles

 California

 USA

University of Texas Southwestern Medical Center

 Dallas

 Texas

 USA

New York University

 New York

 New York

 USA

Case Western Reserve University

 Cleveland

 Ohio

 USA

Georgetown University

 Washington

 District of Columbia

 USA

Neosoma Incorporated

 Groton

 Massachusetts

 USA

University of Pittsburgh

 Pittsburgh

 Pennsylvania

 USA

University of Texas MD Anderson Cancer Center

 Houston

 Texas

 USA

University of Washington

 Seattle

 Washington

 USA

University of Alabama in Birmingham

 Birmingham

 Alabama

 USA

Washington University in St. Louis

 St. Louis

 Missouri

 USA

Vanderbilt University

 Nashville

 Tennessee

 USA

University of Michigan

 Ann Arbor

 Michigan

 USA

Johns Hopkins University School of Medicine

 Baltimore

 Maryland

 USA

University of Wisconsin Madison School of Medicine and Public Health

 Madison

 Wisconsin

 USA

Icahn School of Medicine at Mount Sinai

 New York

 New York

 USA

University of Iowa

 Iowa City

 Iowa

 USA

Stony Brook University

 Stony Brook

 New York

 USA

Oak Ridge National Laboratory

 Oak Ridge

 Tennessee

 USA

Henry Ford Health System

 Detroit

 Michigan

 USA

Baylor College of Medicine

 Houston

 Texas

 USA

University Hospitals Cleveland

 Cleveland

 Ohio

 USA

Case Western Reserve University

 Cleveland

 Ohio

 USA

University of Pennsylvania

 Philadelphia

 Pennsylvania

 USA

Thomas Jefferson University

 Philadelphia

 Pennsylvania

 USA

Christiana Care Health System

 Philadelphia

 Pennsylvania

 USA

University of Maryland

 Baltimore

 Maryland

 USA

James Cancer Center - The Ohio State University

 Columbus

 Ohio

 USA

University of Colorado

 Boulder

 Colorado

 USA

H. Lee Moffitt Cancer Center and Research Institute

 Tampa

 Florida

 USA

American College of Radiology

 Reston

 Virginia

 USA

Brigham and Women's Hospital - Harvard Medical School

 Boston

 Massachusetts

 USA

Intel Corporation

 Santa Clara

 California

 USA

  • S Pati, U Baid, B Edwards, MJ Sheller, …, S Bakas, " Federated Learning Enables Big Data for Rare Cancer Boundary Detection", Nature Communications 13(1), 1-17, 2022. DOI: http://www.doi.org/10.1038/s41467-022-33407-5
  • U Baid, S Pati, TM Kurc, R Gupta, E Bremer, S Abousamra, SP Thakur, JH Saltz, S Bakas, " Federated Learning for the Classification of Tumor Infiltrating Lymphocytes", preprint arXiv:2203.16622.
  • MJ Sheller, B Edwards, GA Reina, J Martin, S Pati, A Kotrotsou, M Milchenko, W Xu, D Marcus, RR Colen, S Bakas, "Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data", Scientific Reports, 10(1):1-12, 2020.
  • MJ Sheller, GA Reina, B Edwards, J Martin, S Bakas, "Multi-Institutional Deep Learning Modeling Without Sharing Patient Data: A Feasibility Study on Brain Tumor Segmentation", MICCAI Brainlesion — Springer LNCS, 11383:92-104, 2018.
  • A. Karargyris, R. Umeton, M. J. Sheller, A. Aristizabal, J. George, A. Wuest, S. Pati, H. Kassem, U. Baid, P. N. Moorthy, A. Chowdhury, J. Guo, S. Nalawade, J. Rosenthal, D. Kanter, M. Xenochristou, D. J. Beutel, V. Chung, T. Bergquist, J. Eddy, A. Abid, L. Tunstall, O. Sanseviero, D. Dimitriadis, Y. Qian, X. Xu, Y. Liu, S. Bala, V. Bittorf, A. Chaudhari, C. Coleman, B. Desinghu, G. Diamos, D. Dutta, D. Feddema, G. Fursin, X. Huang, S. Kashyap, N. Lane, I. Mallick, FeTS Consortium, BraTS-2020 Consortium, AI4SafeChole Consortium, CHAOS Consortium, P. Mascagni, V. Mehta, C. F. Moraes, V. Natarajan, N. Nikolov, N. Padoy, G. Pekhimenko, V. J. Reddi, G. A. Reina, P. Ribalta, A. Singh, J. J. Thiagarajan, J. Albrecht, T. Wolf, G. Miller, H. Fu, D. Xu, P. Yadav, M. Rosenthal, L. Marchionni, M. Loda, J. M. Johnson, S. Bakas, P. Mattson.  MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluation.  Under Review, 2023

Abstracts

  • U Baid, S Pati, S Thakur, B Edwards, M Sheller, J Martin, S Bakas, “NIMG-32. The Federated Tumor Segmentation (FeTS) Initiative: The First Real-World Large-Scale Data-Private Collaboration Focusing on Neuro-Oncology”, Neuro-Oncology, Volume 23, Issue Supplement_6, November 2021, Pages vi135–vi136, https://doi.org/10.1093/neuonc/noab196.532
  • MJ Sheller, GA Reina, B Edwards, J Martin, S Bakas, "Federated Learning In Neuro-Oncology For Multi-Institutional Collaborations Without Sharing Patient Data", Neuro-Oncology, Volume 21, Issue 6, Pages vi176–vi177, 2019.

Past:

  1. RSNA 2021
  2. SNO 2021
  3. ICLR 2021 (May 4-8)
  4. 2020 MED-NeurIPS 2020 - virtual due to COVID-19
  5. 2020 SC'20 (Nov 9-19) - Virtual due to COVID-19
    Live demo
  6. 2019 SNO (Nov. 21-24) - Arizona, USA
    Oral Presentation (slides)
    @ the 24th Annual Scientific Meeting of the Society for Neuro-Oncology
  7. 2019 AACR (date) - place, USA.
    Oral Presentation
    @ the American Association for Cancer Research
  8. 2018 ECOG-ACRIN (Oct.24-26) - Fort Lauderdale, USA
    Oral Presentation
  9. 2018 MICCAI (Sep.16-20) - Granada Conference Center, Granada, Spain
    Oral Presentation
    @ the Medical Image Computing and Computer Assisted Intervention conference

The FeTS Tool, and consensus model produced during the largest FL study [ref], can be found in https://github.com/FETS-AI/Front-End

Linux binaries are available from https://www.nitrc.org/frs/downloadlink.php/13219

It uses OpenFL under the hood for constructing and managing the federation, and that can be found in https://github.com/intel/openfl

The data science algorithm is defined using GaNDLF, and that can be found in https://github.com/mlcommons/GaNDLF

Press Release:

Media coverage:

  • IT-Online: Intel talks trust at Intel Vision

  • Gadget: Intel launched cloud trust service

  • Pipeline Pub: Intel Introduces Cloud-to-Edge and On-Premises Trust Assurance 
  • ITechnology: Intel Introduces Project Amber for Cloud-to-Edge and On-Premises Trust Assurance
  • BusinessWire: Intel Introduces Project Amber for Cloud-to-Edge and On-Premises Trust Assurance
  • Chip.com: "Turkish Technology News Website"
  • HWUpgrade.it: "Italian Technology News Website"
  • Investor.id: "Indonesian Technology News Website"
  • Science Journal: Catching cancer extremely early

  • AI Business: Intel and UPenn to use federated AI for privacy-preserving brain tumor research
  • AI in Healthcarecare: Federated machine learning to take on brain-tumor diagnosis
  • All About Circuits: Is Machine Learning for Tumor Research at Odds With Patient Privacy? Not With Federated Learning, Intel Says
  • Becker's Hospital Review: Penn Medicine, Intel collaborate on AI to identify brain tumors
  • BioWorld: Other news to note for May 11, 2020
  • Brink Wire: Intel and Penn Medicine Partnering to Develop an A.I. That Can Discover Brain Tumors
  • Built In: Federated Learning Fuses Ai And Privacy — And It Could Transform Healthcare
  • BusinessWire:  Intel Works with University of Pennsylvania in Using Privacy-Preserving AI to Identify Brain Tumors
  • CB Insights: This Week In AI: Waymo Raises $750M, Facebook Applies AI To Clinical Trials, Facial Recognition Startup Cloudwalk Raises $254M
  • Click Lancashire Independent News: Intel and University of Pennsylvania are using AI to find brain tumors
  • Digital Trends: Intel and University of Pennsylvania are using A.I. to find brain tumors
  • Digital Trends Live: Apple iPhone 12 Leaks + An All Digital Comic-Con | Digital Trends Live 5.11.20
  • Engadget: Intel and Penn Medicine are developing an AI to spot brain tumors
  • Enterprise Talk: Intel and UPenn Partner with 29 Health Organizations to Train AI Models
  • Explica: Artificial intelligence could detect brain tumors 
  • FierceElectronics: Intel and UPenn head group using AI to find brain tumor
  • Grvn
  • Healthcare IT News: Penn Medicine, Intel developing new AI approach to detecting brain tumors
  • HealthIT Analytics: UPenn, Intel Partner to Use Machine Learning to Detect Brain Tumors
  • HIT Consultant: Intel, UPenn Form AI Initiative to Identify Brain Tumors via Secure Data
  • HPCwire
  • iGamesNews
  • InfoTechLead: Intel and Penn Medicine use AI to identify brain tumors
  • InsideHPC
  • Investor Ideas Podcast: The AI Eye Episode 247: Intel Labs (NasdaqGS: $INTC) Working with Penn Medicine on Development of AI Models for Brain Tumor Identification, IBM (NYSE: $IBM) Announces Vodafone Idea Ltd. (NSE: $IDEA) Achieves Milestone on Open Universal Hybrid Cloud
  • Journal of Cyber Policy: Intel Works With University Of Pennsylvania In Using Privacy-Preserving Ai To Identify Brain Tumors
  • Kaiser Health News: When Sharing Research Data Is Rare, This Novel Approach On Mapping Brain Tumors Brings Together 30 Centers
  • MarketWatch: The AI Eye Episode 247: Intel Labs Working with Penn Medicine on Development of AI Models for Brain Tumor Identification, IBM Announces Vodafone Idea Ltd. Achieves Milestone on Open Universal Hybrid Cloud
  • MedCity News: UPenn, Intel partner to use federated learning AI for early brain tumor detection
  • Mike Raves Wordpress: Intel and Penn Medicine are developing an AI to spot brain tumors
  • MobiHealthNews: Welltok adds four new digital programs, Atrium Health adopts Butterfly's handheld ultrasound and more digital health deals
  • Seeking Alpha: Intel looking to improve tumor detection 
  • SlashGear: This AI is learning to spot brain tumors – without infringing privacy
  • Somagnews
  • STAT News: Hospitals are reluctant to share data. A new effort to map brain tumors with AI is getting their help another way
  • stateOfPress
  • TechTimes: Intel and Penn Medicine Partnering to Develop an A.I. That Can Discover Brain Tumors
  • TheBest.gr (Interview in Greek): Researcher from Patras (Greece) leads a collaboration of 30 institutions to a novel model for cancer detection
  • The Breaking News Headlines
  • The Burn In: Intel using AI to identify brain tumors and protect privacy
  • Wall Street Journal Pro AI: Intel, Health Institutions to Use Emerging AI Technique to Improve Tumor Detection
  • Yahoo Finance
  • VentureBeat: Intel partners with Penn Medicine to develop brain tumor classifier with federated learning
  • Unite.ai
  • Welcome AI: Federated Learning for Medical Imaging
  • World-Today-News: This AI detects brain tumors while respecting data confidentiality
  • ZDNet: Intel, UPenn partner with 29 health organizations to train AI to spot brain tumors
  • Geekzilla: Intel collaborates with AI to identify brain tumors
  • Mobile Syrup: Intel, Penn Medicine to co-develop AI tool for identifying brain tumours
  • Olhar Digital: Research centers want to teach AI to identify brain tumors
  • Technocio: Intel collaborates with the University of Pennsylvania in the use of intelligence to identify brain tumors
  • Tecnogaming: Federal learning preserves patient data to identify brain tumors
  • Ciber Sur: Intel and University of Pennsylvania to Use Privacy-Protective AI to Identify Brain Tumors 
  • CorCom: Brain tumor, AI and machine learning for early diagnosis
  • Fanáticos Hardware: Intel works with the University of Pennsylvania on the use of Artificial Intelligence to identify brain tumors 
  • Fudzilla: Intel sets its AI onto brain tumours 
  • Hats New: Intel will work on artificial intelligence specialized in detecting brain tumors
  • KultureGeek: Intel's working on an AI to detect brain tumors –
  • La Gazette du Laboratoire : Intel collaborates with the University of Pennsylvania in the use of AI to identify brain tumors while preserving privacy
  • L’Usine Digitale: This artificial intelligence detects brain tumours while preserving the confidentiality of the data
  • Muy Computer Pro: Intel to Develop Artificial Intelligence to detect brain tumors
  • Presse Citron: This AI detects brain tumours while respecting the confidentiality of the data
  • Punto Informatico: From Intel an AI against brain tumor
  • TechPrincess: Intel and Penn Medicine will develop a brain tumor classifier through federated learning
  • Tecnelab: Intel and the University of Pennsylvania use AI to identify brain tumors
  • Techeconomy: Artificial intelligence to identify brain tumors
  • Businessworld: Intel Works with the University of Pennsylvania in Using Privacy-Preserving AI to Identify Brain Tumors
  • Cell IT: Intel Works with University of Pennsylvania in Using Privacy-Preserving AI to Identify Brain Tumors
  • Financial Express: AI to speed brain tumour diagnosis
  • Gadgets Now: Intel to develop technology to train AI help identify brain tumors
  • Indiatimes: AI effort to detect brain tumor early and save over 80,000 lives launched worldwide
  • The Medical AI Times: AI privacy protection to spot brain tumors – Federated learning from Intel and University of Pennsylvania
  • The Times of India: Intel to develop technology to train AI help identify brain tumors
  • VAR India: Intel with University of Pennsylvania enables Privacy-Preserving AI to identify brain tumors
  • ZDNet Japan: Intel, UPenn partner with 29 health organizations to train AI to spot brain tumors

Advisors

Contributors (alphabetical order):

  • Baid, Ujjwal
  • Bergman, Mark
  • Bhalerao, Megh
  • Edwards, Brandon     (Intel Labs)
  • Pati, Sarthak     (Lead Developer - UPenn)
  • Reina, G Anthony     (Intel AI)
  • Sheller, Micah     (Lead Developer - Intel Labs)
  • Thakur, Siddhesh P.
  • Wang, Shih-han “Hans” (Intel Labs)
  • Xu, Weilin     (Intel Labs)

 

Supporting Grant: This work is partly funded through the NIH/NCI/ITCR-supported grant U01CA242871.

Disclaimer: The software is designed for research purposes and is neither FDA-approved, nor CE-marked.

 

Contact CBICA Software for questions, etc.