A clinical feasibility and performance study on the use of IntelligynAI for AI-driven support in ultrasound assessment of ovarian tumours

ISRCTN ISRCTN90989270
DOI https://doi.org/10.1186/ISRCTN90989270
Secondary identifying numbers CIV-ID: CIV-24-02-046166
Submission date
01/11/2024
Registration date
18/12/2024
Last edited
18/12/2024
Recruitment status
Recruiting
Overall study status
Ongoing
Condition category
Urological and Genital Diseases
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data
Record updated in last year

Plain English Summary

Background and study aims
A critical shortage of expert ultrasound examiners has raised concerns of unnecessary interventions and delayed cancer diagnoses. AI support has the potential to reduce this burden and improve patient outcomes. Our team was the first to demonstrate that Deep Neural Network (DNN) models applied to ultrasound images can identify ovarian cancer in women with accuracy comparable to that of an experienced ultrasound expert (DOI: 10.1002/uog.23530). Recently, we confirmed in a large international multicentre validation study that these results are generalizable across different populations, ultrasound equipment, and examiners of varying levels of experience (Nature Medicine, accepted Oct 1st, 2024).

This study aims to evaluate a clinical workflow where examining physicians receive AI-driven support in real-time while performing an ultrasound examination of an ovarian lesion. Specifically, we want to assess:
• Whether the examining physician can produce and select ultrasound images suitable for AI analysis.
• How AI support impacts the physician’s workflow and work environment.
• How AI support influences the physician’s diagnostic confidence and patient management decisions.
• The alignment between the physician’s assessment, using AI support, and the final outcome from surgery or ultrasound follow-up over at least 9 months.

Who can participate?
Women over 18 years of age with a newly detected ovarian lesion, who are examined at the Department of Obstetrics and Gynecology at Södersjukhuset, are eligible to participate.

What does the study involve?
The study involves a clinical evaluating of an AI-driven support tool designed to assist in the ultrasound assessment of ovarian tumours.

What are the benefit and risk for the participants?
Scientific studies suggest that AI-driven decision support can contribute to faster and more accurate diagnostics, potentially avoiding unnecessary surgeries and enabling erlier cancer detection. However, for individual patients, there is a possibility that the AI model may provide an assessment that does not align with the final diagnosis determined by surgery. Importantly, it remains the attending physician's responsibility to determine the appropriate follow-up or treatment in consultation with the patient. The AI-driven decision support should be viewed solely as an advisory tool.

Where is the study run from?
The study is conducted by Karolinska Institutet in collaboration with Södersjukhuset, both located in Stockholm, Sweden.

When is the study starting and how long is the study expected to run for?
March 2024 to December 2026

Who is funding the study?
Karolinska Institutet, Stockholm Sweden is the sponsor of the study. The study is funded by Vinnova (the Swedish Agency for Innovation Systems) (Dnr 2024-01893).

Who is the main contact?
Professor Elisabeth Epstein, elisabeth.epstein@ki.se

Contact information

Prof Elisabeth Epstein
Public, Scientific, Principal Investigator

Department of Clinical Science and Education, karolinska Institutet
Södersjukhuset
Sjukhusbacken 10
Stockholm
11883
Sweden

ORCiD logoORCID ID 0000-0003-2298-7785
Phone +46 852487570
Email elisabeth.epstein@ki.se

Study information

Study designSingle-centre regulatory study evaluating the feasibility and performance of an AI-driven diagnostic support device, IntelligynAI, for the assessment of ovarian tumours. The study integrates IntelligynAI into the clinical workflow for ultrasound evaluations.
Primary study designObservational
Secondary study designCase series
Study setting(s)Hospital
Study typeDiagnostic, Other
Participant information sheet Not avaliable in web format, please use the provided contact details to request a participant information sheet.
Scientific titleA clinical feasibility and performance study on the use of IntelligynAI for computer-aided diagnostic support (CADs) in ultrasound assessment of ovarian tumours
Study acronymIntelligynAI-FS
Study hypothesisThe goal of this study is to evaluate the clinical feasibility and physician’s perspectives on AI-driven support for the ultrasound assessment of ovarian tumours. Specifically, we aim to evaluate:
1. Workflow and Work Environment: How the AI support impacts the physician’s workflow and work environment.
2. Confidence in Diagnosis: Whether the AI support increases the physician’s confidence in diagnosing and managing the patient.
3. Image Quality for AI Analysis: The physician’s ability to produce and select ultrasound images suitable for AI analysis.
4. Alignment with Final Outcomes: How well the physician’s assessment, with AI support, aligns with the final outcomes from surgery or ultrasound follow-up over at least 9 months.
Ethics approval(s)

1. Approved 29/05/2024, The Swedish Ethical Review Authority (Etikprövningsmyndigheten Box 2110, Uppsala, 75002, Sweden; +46 10-475 08 00; registrator@etikprovning.se), ref: Dnr 2024-03312-01

2. Approved 15/05/2024, The Swedish Medical Products Agency (Läkemedelsverket Box 26, Uppsala, 751 03, Sweden; +46 18-17 46 00; registrator@lakemedelsverket.se), ref: 5.1-2024-28221

ConditionWomen with newly detected ovarian lesions, undergoing transvaginal ultrasound examination.
InterventionThe study aims to asses a clinical workflow where examining physicians utilize AI-driven diagnostic support. During the ultrasound examination, selected images are sent to the IntelligynAI platform, which returns a report within seconds. This report includes an ovarian cancer risk prediction and a management proposal.
Intervention typeDevice
Pharmaceutical study type(s)Testing of a medical device
PhaseNot Applicable
Drug / device / biological / vaccine name(s)IntelligynAI
Primary outcome measureSelf-perceived confidence in the diagnosis and management provided by the examiner, in a study protocol, at the baseline ultrasound examination, self-perceived satisfaction and workload using AI support, through a doctor´s questionnaire, at the end of the trial
Secondary outcome measures1. Percentage of cases with adequately collected and selected images, trough the review of patients files at the end of the trial
2. Diagnostic accuracy: Alignment of the physician’s assessment with AI support, trough the study protocol filled out by the examiner at the time of the baseline ultrasound examination against final outcomes (from histology or ultrasound follow-up over at least 9 months), through the review of patient's files, at the end of the trial
Overall study start date01/03/2024
Overall study end date31/12/2026

Eligibility

Participant type(s)Patient
Age groupAdult
Lower age limit18 Years
SexFemale
Target number of participants60
Participant inclusion criteriaWomen with newly detected adnexal lesions (known for less than 4 months).
Participant exclusion criteriaIndividuals with a mental or psychological disability limiting their ability to give informed consent. Women with adnexal lesions known for more than 4 months. Women under 18 years of age.
Recruitment start date01/01/2025
Recruitment end date31/12/2026

Locations

Countries of recruitment

  • Sweden

Study participating centre

Södersjukhuset
Sjukhusbacken 10
Stockholm
11883
Sweden

Sponsor information

Karolinska Institutet
University/education

Sjukhusbacken 10
Stockholm
11883
Sweden

Phone +46 852487508
Email erik.melen@ki.se
Website https://ki.se
ROR logo "ROR" https://ror.org/056d84691

Funders

Funder type

Industry

VINNOVA
Government organisation / National government
Alternative name(s)
Swedish Governmental Agency for Innovation Systems
Location
Sweden

Results and Publications

Intention to publish date30/10/2027
Individual participant data (IPD) Intention to shareYes
IPD sharing plan summaryPublished as a supplement to the results publication
Publication and dissemination planPlanned publication in a peer-reviewed journal
IPD sharing planThe datasets generated during this study, with the execption of the ultrasound images, will be published as a supplement to the publication of the study results.

Editorial Notes

01/11/2024: Trial's existence confirmed by The Swedish Ethical Review Authority.