ai.hackcv
论文精选 65arXiv

DermDepth: Toward Monocular Metric Scale 3D Reconstruction Models for Dermatology· 皮肤病学中的单目 3D 重建

Dermatological practice routinely involves measuring and tracking lesion size, morphology and texture, as critical components of wound or skin cancer screening, monitoring and diagnosis. To accomplish this task, practitioners often image the skin surface with commonly available off-the-shelf camera sensors. This has led to an overwhelming research focus on 2D methods while these objectives naturally benefit from 3D information. In this paper, we demonstrate that dense monocular 3D reconstructions, metric scale measurements and rich surface normal texture estimates are achievable for both dermoscopic and macroscopic cases without the need for additional hardware or multiple captures. We present DermDepth, the first single-view metric scale 3D model for the dermatological domain and D-Synth, the first synthetic dermoscopic dataset with pixel-perfect 3D information. Our experiments show training DermDepth on D-Synth corrects metric scale error from over 16x to under 1.1x for real dermoscopic data, while preserving geometric quality and increasing texture richness. Fine-tuning on a small amount of real clinical samples generalizes our method across three real-world benchmarks spanning the few mm to hundred cm range, diverse skin-tones, chronic wound cases and produces measurements broadly consistent with disease size reported in medical literature. All code, data and models are available at https://github.com/hectorcarrion/dermdepth.

AI 解读论文

皮肤病学单目 3D 重建模型取得重大进展

核心方法
提出了DermDepth模型和D-Synth数据集,通过单一图像视角实现皮肤病变的密集3D重建、度量尺度测量和表面法线纹理估计。
适合谁读
研究者、工程师、医学专业人员
要解决的问题
皮肤病学中需要准确测量和跟踪皮肤病变的大小、形态和纹理,但当前方法多限于2D,无法充分利用3D信息。
关键实验
实验表明,DermDepth在D-Synth数据集上的训练可将度量尺度误差从16倍减少到1.1倍,同时保持几何质量和增加纹理丰富度。
主要贡献
首次在皮肤病学领域实现了单目度量尺度的3D重建,并提供了一个带有完美3D信息的合成数据集。
意义与局限
该研究为皮肤病学提供了新的3D测量工具,有助于提高诊断和监测的准确性,但合成数据集与真实临床数据之间仍存在差距。
领域:cs.CV作者:Héctor Carrión、Narges Norouzi
相关推荐
论文精选 60已解读

Principia: Relational Physics Tests for Video Models· Principia:视频模型的物理测试

Evaluating physical reasoning in video models is difficult because absolute motion measure…

领域:cs.CV作者:Varun Varma Thozhiyoor、Shivam Tripathi、Venkatesh Babu Radhakrishnan
📎 arXiv🕒 09-04 01:59🔗 arxiv.org

本站内容由 LLM 精选聚合,原文版权归 arXiv 所有 · 摘录仅供参考