back Back

New AI tool detects cancer quicker, with sharper focus

Jan. 03, 2024.
2 min. read 1 Interactions

Could speed up disease diagnosis and image interpretation, and determine which patients would benefit most from immunotherapy

About the writer

Amara Angelica

187.5701 MPXR

Amara Angelica is Senior Editor, Mindplex

iStar AI was able to automatically detect tumor and cancer cells from single-cell-level gene expression computed from the predicted superpixel-level gene expression associated with specific genes (credit: University of Pennsylvania)

Researchers have developed a new AI tool that interprets medical images with unprecedented clarity and could speed up disease diagnosis and image interpretation.

The tool, called iStar (Inferring Super-Resolution Tissue Architecture), was developed by researchers at the Perelman School of Medicine at the University of Pennsylvania.

The researchers say the iStat tool would allow doctors and researchers to see cancer cells that might otherwise have been virtually invisible. It could also determine whether safe margins were achieved through cancer surgeries and automatically provide annotation for microscopic images, paving the way for molecular disease diagnosis at that level.

A paper on the method was published today in Nature Biotechnology.

Deciding when immunotherapy is needed

Mingyao Li, PhD, a professor of Biostatistics and Digital Pathology, said iStar can automatically detect critical anti-tumor immune formations called “tertiary lymphoid structures,” a patient’s likely survival and favorable response to immunotherapy. This means, Li said, that iStar could be a powerful tool for determining which patients would benefit most from immunotherapy.

Li and her colleagues trained a machine-learning tool called the “Hierarchical Vision Transformer” on standard tissue images. It breaks down images into different stages, and these images are used to predict gene activities, often at near-single-cell resolution.

213 times faster than other AI tools

To test the efficacy of the tool, Li and her colleagues evaluated iStar on many different types of cancer tissue, including breast, prostate, kidney, and colorectal cancers, mixed with healthy tissues. iStar was able to automatically detect tumor and cancer cells that were hard to identify just by eye. iStar was also 213 times faster than other AI tools.

This research was funded by the National Institutes of Health (R01GM125301 and R01HG013185).

Citation: Zhang, D., Schroeder, A., Yan, H. et al. Inferring super-resolution tissue architecture by integrating spatial transcriptomics with histology. Nat Biotechnol (2024).

Let us know your thoughts! Sign up for a Mindplex account now, join our Telegram, or follow us on Twitter

Comment on this content


0 thoughts on “New AI tool detects cancer quicker, with sharper focus





💯 💘 😍 🎉 👏
🟨 😴 😡 🤮 💩

Here is where you pick your favorite article of the month. An article that collected the highest number of picks is dubbed "People's Choice". Our editors have their pick, and so do you. Read some of our other articles before you decide and click this button; you can only select one article every month.

People's Choice