Skip to main content
Email

The latest news in Healthcare IT – straight to your inbox.

Home
  • Main Menu
  • Subscribe
  • Topics
    • Video
    • Analytics
    • Artificial Intelligence
    • Cloud Computing
    • EHR
    • Government & Policy
    • Interoperability
    • Patient Engagement
    • Population Health
    • Precision Medicine
    • Privacy & Security
    • Telehealth
    • Women In Health IT

Regions

  • ANZ
  • ASIA
  • EMEA
  • Global Edition
Global Edition
Imaging

Health system moves from text-only to AI-powered interactive multimedia radiology reports

The University of Virginia Health System wanted to create interactive multimedia reports, believing that radiologists could communicate better through the use of enriched and interactive content.
By Bill Siwicki
November 12, 2018
01:41 PM

The radiology report is the principle work product of the radiologist. Until recently, reports describing findings in imaging studies have been plain, text-only documents. Such reports are increasingly inadequate.

THE PROBLEM

“Traditional radiology reports are limited to plain-text in order to simplify the transport of results across information systems,” said Dr. Cree Gaskin, associate chief medical information officer and vice-chair of informatics and operations, division director of musculoskeletal imaging, at the University of Virginia Health System in Keswick, Virginia. “One cost is that report consumers are often stuck reviewing blocks of bland text in one system, and comparing to the images themselves in another system.”

Because radiology reporting applications typically are separate from the applications used to view images, radiologists are hindered in their ability to create interactive reports that connect directly to imaging findings, he added. The University of Virginia Health System wanted to create AI-powered, interactive multimedia reports, believing that radiologists could communicate better through the use of enriched and interactive content.

PROPOSAL

The University of Virginia Health System implemented interactive multimedia reporting via a hybridized viewing-reporting application. More specifically, it used AI-driven Vue Reporting embedded in Vue PACS by vendor Carestream Health.

Webinar: Bringing Intelligence to Healthcare from AI to Machine Learning

“This hybridized viewing-reporting application supports the radiologist in transporting image-related information into the report, and in turn, for the report consumer, the report becomes interactive and connected back to the images,” Dr. Gaskin said. “Advanced reports support the use of rich content, like styled text, images, tables, graphs and hyperlinks, to improve communication around medical imaging findings. These enhancements can add speed and clarity to report and image review.”

MARKETPLACE

There are many imaging and PACS technology vendors serving the healthcare marketplace. These vendors include AGFA Healthcare, Apollo Enterprise Imaging, GE Healthcare, Canon USA, Dicom Systems, FUJIFILM Medical Systems USA, Hyland Healthcare, Konica Minolta, Lumedx, Philips, Sectra, Siemens Healthineers and Singular Medical Technologies.

MEETING THE CHALLENGE

Radiologists now view and report images from the same application, so it’s easier to create interactive multimedia reports. The technology is used by radiologists – residents, fellows and faculty. They all needed to learn to report from a new application and adopt new multimedia reporting habits. One reports a little differently when adding rich content rather than just plain-text.

“We can measure findings on the images, and have these measurements and image locations import automatically into the report without dictating them,” Dr. Gaskin explained. “We can mark key findings with arrows and add connectors into the report. Report consumers can click on hyperlinks within the report to launch the relevant annotated images.”

This saves them time in results review and improves the clarity of reports, he added.

“I’ve had referring doctors comment that they thought we were talking about one thing in our report, only to click a link and see that we were talking about a different finding on the images,” he said. “We can also place key images directly into the report. You know the old adage – a picture tells a thousand words. A radiologist could create a 3-D cinematic rendering of a CT scan showing fractures and add that special image directly into the report to visually sum the findings.”

It can be easier to digest AI-refined complex information visually than to read lengthy descriptions, he said. And patients will be more engaged by seeing images in their reports, he added.

"The use of formatted text allows us to make statements stand out in bold, underline or color for emphasis. It’s only natural for your eyes to be drawn to styled text against a background of plain black text."

Dr. Cree Gaskin, University of Virginia Health System

“They may not need to review the entire study – just a key image or two to better understand what’s going on,” he explained. “Also, the use of formatted text allows us to make statements stand out in bold, underline or color for emphasis. It’s only natural for your eyes to be drawn to styled text against a background of plain black text.”

The University of Virginia Health System uses the Epic electronic health record. To date, staff has been able to place interactive multimedia reports in the EHR in the form of PDFs. They also have links in the EHR that launch an image and multimedia report viewer – Vue Motion from Carestream Health.

“Thus, our clinicians are able to access a full imaging study and the interactive multimedia report when starting from the EHR,” Dr. Gaskin said. “We currently are working with Epic and Carestream to get the enriched content available in-line or more directly within the EHR itself. We are excited about this opportunity to further improve clinician access to our interactive multimedia reports. We currently are in a testing phase.”

RESULTS

The University of Virginia Health System has had technical success in creating AI-powered, interactive multimedia reports and making them visible to referring providers and patients. It has examined the frequency that reports contain hyperlinks to imaging findings in the PACS.

“For our more complex reports like PET-CT, CT and MRI, we know that our radiologists very commonly are doing this,” Dr. Gaskin said. “This data has been accepted for publication in the Journal of the American College of Radiology. We believe that our adoption rates indicate that our radiologists find value in the technique, or they would not have bothered to make an elective change in their reporting habits.”

The University of Virginia Health System is interested in tracking how often patients and referring providers click on the interactive content within reports, but staff is just beginning to look at this.

“We know anecdotally that our radiologists commonly find convenience in clicking the links in previous reports when comparing to previous studies, but we have not yet quantified this impact,” he said.

ADVICE FOR OTHERS

“I support the transition into interactive multimedia reporting because I believe it improves the communication around imaging findings,” Dr. Gaskin said. “Very little media uses plain-text only to communicate complex information these days. It only makes sense for radiology reporting to evolve so that rich content is routine.”

It is a departure from conventional reporting practice, so it helps to have radiologists onboard with the decision to implement such technology on the front end, he added. However, if radiologists are not onboard, one can implement the technology and they may come to use it over time.

“Our application absolutely supports the old way of plain-text only reporting, so reluctant users can continue their old habits while others adopt the newer technique,” he explained. “It took a little training and months of availability for our radiologists to pick up the interactive multimedia reporting techniques. And some still don’t do it. It takes time to learn new habits.”

Creating interactive multimedia reports is not the same as disseminating them, he added. Organizations will need to consider integration of advanced reports into their existing or future information systems, he advised. One needs a mechanism to share the interactive multimedia content, he said. The University of Virginia Health System technology worked for them, he said, but the technology is continuing to improve.

Dr. Gaskin will be speaking on the subject of AI at HIMSS19 in a session titled “Enhancing Care with AI-Driven Interactive Multimedia Reports.” It's scheduled for Tuesday, February 12, from 10:30-11:30 a.m. in room W311E.

Focus on Artificial Intelligence

In November, we take a deep dive into AI and machine learning.

Topics: 
Artificial Intelligence, HIMSS19, Imaging, Interoperability

More regional news

Patient does a virtual care consult

Castlight Health intros virtual urgent care for members

By
Mike Miliard
April 18, 2025
HIMSSCast logo

HIMSSCast: Should every healthcare organization have an AI strategy?

By
Mike Miliard
April 18, 2025
Nurse checks tablet to communicate on shift

Zoom launches agentic AI-powered mobile comms for frontline staff

By
Andrea Fox
April 18, 2025
Want to get more stories like this one? Get daily news updates from Healthcare IT News.
Your subscription has been saved.
Something went wrong. Please try again.

Top Story

Nurse checks tablet to communicate on shift
Zoom launches agentic AI-powered mobile comms for frontline staff

Most Read

How UCHealth is reducing fall injuries with AI-enhanced risk modeling
2025: AI enhances personalized care; caregiver experience in the spotlight
Frontera launches with $32M in seed funding
Korea University Medical Center pursues brain, heart AI development and more briefs
Roundup: AI and cloud tackle cyber risk and improve workflows
HIMSSCast: Fundamentals of data governance - lessons from UNC Health, part 1

Research

White Papers

More Whitepapers

Telehealth
Create secure, connected omnichannel communications
Telehealth
Let us guide you to HIPAA compliance
Cloud Computing
How a cloud communications platform puts connection at the center of care

Webinars

More Webinars

Analytics
Standby Eligibility and Claims Solutions: Diversify Your Risk & Ensure Business Continuity
Interoperability
Nursing Leadership, Operational Innovation, and Emerging Technologies with AONL
Artificial Intelligence
Loving the AI Revolution: How Automation is Humanizing Healthcare and Improving Provider Well-Being

Video

Ilir Kullolli, Stanford Medicine Children's Health_Las Vegas skyline Photo by halbergman/E+/Getty Images
HIMSS-ACCE working together to advance digital health
Vik Bajaj, Foresite Labs_Medical research Photo by Edward Jenner/pexels.com
Healthcare research is being affected by federal budget cuts
Priyanka Jain, Evvy_Hand holding sample vial Photo courtesy of Evvy
How one women's health startup tests fertility outcomes
Keisuke Nakagawa, UC San Diego Health_Las Vegas skyline Photo by halbergman/E+/Getty Images
Can technology help bring the human touch back to medicine?

More Stories

Lee Kim, HIMSS_Las Vegas skyline Photo by halbergman/E+/Getty Images
Past year's data breaches often stemmed from remediable cybersecurity gaps
Cathy Menkiena, Health Catalyst_Las Vegas skyline Photo by halbergman/E+/Getty Images
Innovative – and useful – tech is key to empowering care teams
Sameer Sethi of Hackensack Meridian Health on AI
Hackensack Meridian Chief AI Officer on the intersection of business and technology
Doctor checking and tracking information on a computer
HHS updates regulatory guides for the safe use of EHRs
Sameer Sethi, Hackensack Meridian Health_Computer neural network concept Photo by dan/Moment/Getty Images
Chief AI Officer on becoming one and working with the C-suite
Businessperson signing piece of paper
White House releases guidance on federal AI use and procurement
Dr. Ateev Mehrotra of Brown University School of Public Health on telehealth policy
Brown University policy expert talks about the future of telehealth flexibilities
Micky Tripathi, former HHS acting chief AI officer
Former National Coordinator headed to Mayo Clinic, reports say
Home

More News

  • MobiHealthNews
  • Healthcare Finance News
  • Healthcare Payers News

Newsletter Signup

HIMSS25 European Health Conference & Exhibition
HIMSS25 European Health Conference & Exhibition
Get ready for knowledge-sharing, all the latest innovations, and in-depth demos with Europe's most influential healthcare community.
10 - 12 June, 2025 | Paris
Learn More
AI in Healthcare Forum
AI in Healthcare Forum
The HIMSS AI in Healthcare Forum cuts through the hype to showcase real-world examples illustrating the transformative potential, and realistic challenges of AI application across the care continuum.
10 - 11 July 2025 | New York
Learn More

Footer Menu

  • About
  • Advertise
  • Reprints
  • Contact
  • Privacy Policy

© 2025 Healthcare IT News is a publication of HIMSS Media

X

Topics

  • Video
  • Analytics
  • Artificial Intelligence
  • Cloud Computing
  • EHR
  • Government & Policy
  • Interoperability
  • Patient Engagement
  • Population Health
  • Precision Medicine
  • Privacy & Security
  • Telehealth
  • Women In Health IT

Career

  • Events
  • Jobs
  • Research Papers
  • Webinars

More

  • About
  • Advertise
  • Contact
  • Special Projects
  • Video

Regions

  • ANZ
  • ASIA
  • EMEA
  • Global Edition

The Daily Brief Newsletter

Get daily news updates from Healthcare IT News.

Search form

Top Stories

Nurse checks tablet to communicate on shift
Zoom launches agentic AI-powered mobile comms for frontline staff
HIMSSCast logo
HIMSSCast: Should every healthcare organization have an AI strategy?
Vik Bajaj, Foresite Labs_Medical research Photo by Edward Jenner/pexels.com
Healthcare research is being affected by federal budget cuts