Unified Multimodal Approaches and Advanced Pathology Models

The recent developments in the field of medical imaging and computational pathology are marked by a significant shift towards unified and multimodal approaches. Researchers are increasingly focusing on creating large-scale, open-source datasets and models that can handle diverse medical imaging modalities, thereby enhancing the applicability and generalizability of these tools. Vision-Language Models (VLMs) are being adapted and optimized for medical domains, with notable advancements in zero-shot and few-shot learning capabilities. Additionally, there is a growing emphasis on integrating patch-level and whole-slide image analysis, as well as on developing models that can perform a wide array of tasks within the pathology domain. Instruction-tuning and mixed-modal generative models are also emerging as powerful tools for creating biomedical assistants capable of handling complex, multimodal tasks. Furthermore, the field is witnessing innovations in fine-tuning single-cell foundation models for molecular perturbation prediction, enabling zero-shot generalization to unseen cell lines. Lastly, there is a push towards improving the interpretability and robustness of medical visual question answering models through hierarchical expert verification reasoning chains.

Noteworthy papers include one introducing a unified VLM for multiple medical imaging modalities that significantly outperforms existing models, and another presenting a multimodal foundation model for patch and whole-slide image analysis in computational pathology, achieving state-of-the-art performance across diverse tasks.

Sources

UniMed-CLIP: Towards a Unified Image-Text Pretraining Paradigm for Diverse Medical Imaging Modalities

Telepathology in Hematopathology Diagnostics: A Collaboration Between Ho Chi Minh City Oncology Hospital and University of Texas Health-McGovern Medical School

SEW: Self-calibration Enhanced Whole Slide Pathology Image Analysis

CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathology

MedMax: Mixed-Modal Instruction Tuning for Training Biomedical Assistants

Efficient Fine-Tuning of Single-Cell Foundation Models Enables Zero-Shot Molecular Perturbation Prediction

MedCoT: Medical Chain of Thought via Hierarchical Expert

Built with on top of